Jul 27 19:05:17.709425 ip-10-0-132-61 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 19:05:18.030724 ip-10-0-132-61 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:18.030724 ip-10-0-132-61 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 19:05:18.030724 ip-10-0-132-61 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:18.030724 ip-10-0-132-61 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 19:05:18.030724 ip-10-0-132-61 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 19:05:18.032284 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.032092    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 19:05:18.036114 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036097    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.036114 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036114    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036118    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036121    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036125    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036127    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036130    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036133    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036136    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036139    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036142    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036145    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036147    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036150    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036152    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036155    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036157    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036161    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036178    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036184    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036188    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.036192 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036192    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036195    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036198    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036201    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036204    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036207    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036209    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036212    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036214    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036217    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036219    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036222    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036225    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036227    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036230    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036232    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036234    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036238    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036240    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036243    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.036717 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036245    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036248    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036250    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036254    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036258    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036261    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036263    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036266    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036268    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036271    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036273    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036276    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036279    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036282    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036284    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036287    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036289    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036292    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036295    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.037211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036298    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036300    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036302    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036305    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036308    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036310    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036312    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036315    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036318    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036320    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036323    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036326    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036328    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036331    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036334    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036336    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036339    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036341    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036344    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.037674 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036346    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036349    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036353    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036356    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036359    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036363    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036367    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036371    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036374    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036376    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036380    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036383    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036386    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036389    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036392    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036394    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036396    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036399    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036401    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.038132 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.036404    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037154    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037161    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037183    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037187    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037191    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037194    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037197    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037200    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037202    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037205    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037208    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037211    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037215    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037218    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037220    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037223    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037226    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037230    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.038626 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037233    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037236    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037239    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037241    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037244    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037247    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037249    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037251    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037254    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037257    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037259    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037261    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037264    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037266    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037268    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037271    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037273    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037276    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037278    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037281    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037283    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.039080 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037286    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037288    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037291    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037293    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037295    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037298    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037301    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037303    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037306    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037308    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037311    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037315    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037318    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037320    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037323    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037325    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037328    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037330    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037332    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.039612 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037335    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037337    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037341    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037344    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037347    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037350    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037353    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037355    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037357    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037360    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037362    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037365    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037367    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037371    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037373    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037375    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037378    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037380    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037383    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.040083 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037385    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037387    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037390    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037393    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037395    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037398    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037401    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037404    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037407    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037409    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037412    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037414    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037417    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037419    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037422    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037424    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037426    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037429    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037431    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037434    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.040601 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037436    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037440    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037861    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037866    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037869    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037872    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037875    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037878    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037880    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037883    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037885    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037888    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037891    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037894    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037896    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037899    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037901    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037904    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037908    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.041078 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037910    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037913    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037917    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037921    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037924    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037927    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037929    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037932    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037934    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037936    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037939    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037941    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037944    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037946    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037949    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037951    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037953    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037956    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037958    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.041548 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037960    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037963    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037965    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037967    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037970    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037972    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037974    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037977    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037979    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037982    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037984    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037987    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037990    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037993    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037996    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.037998    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038001    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038003    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038006    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038008    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.042042 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038010    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038013    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038016    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038018    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038022    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038026    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038029    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038031    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038034    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038036    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038038    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038041    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038043    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038046    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038048    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038050    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038052    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038055    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038057    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.042576 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038060    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038062    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038065    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038067    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038070    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038074    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038077    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038080    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038083    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038086    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038089    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038092    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038095    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038098    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038100    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038103    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038106    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038108    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038111    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.043131 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038113    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038115    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038118    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038120    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038123    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038218    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038229    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038239    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038244    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038248    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038251    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038255    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038260    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038263    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038266    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038269    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038272    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038275    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038278    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038281    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038284    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038288    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038291    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 19:05:18.043650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038295    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038297    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038300    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038303    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038307    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038310    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038313    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038316    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038319    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038322    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038333    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038336    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038340    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038342    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038349    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038353    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038355    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038358    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038361    2558 flags.go:64] FLAG: --enable-server="true"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038364    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038368    2558 flags.go:64] FLAG: --event-burst="100"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038371    2558 flags.go:64] FLAG: --event-qps="50"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038374    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038377    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 19:05:18.044195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038380    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038384    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038387    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038391    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038394    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038397    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038399    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038404    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038407    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038409    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038412    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038415    2558 flags.go:64] FLAG: --feature-gates=""
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038418    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038421    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038424    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038427    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038430    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038433    2558 flags.go:64] FLAG: --help="false"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038435    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038438    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038441    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038444    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038448    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 19:05:18.044802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038451    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038454    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038457    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038460    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038462    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038465    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038468    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038471    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038473    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038476    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038479    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038482    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038488    2558 flags.go:64] FLAG: --lock-file=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038490    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038493    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038496    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038502    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038505    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038507    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038510    2558 flags.go:64] FLAG: --logging-format="text"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038513    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038516    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038519    2558 flags.go:64] FLAG: --manifest-url=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038522    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038529    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 19:05:18.045425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038532    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038536    2558 flags.go:64] FLAG: --max-pods="110"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038538    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038541    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038544    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038547    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038551    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038554    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038557    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038564    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038567    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038570    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038573    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038576    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038581    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038584    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038587    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038589    2558 flags.go:64] FLAG: --port="10250"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038592    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038596    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb30a0ba6440c9c3"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038599    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038602    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038605    2558 flags.go:64] FLAG: --register-node="true"
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038608    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 27 19:05:18.046159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038612    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038615    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038618    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038621    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038624    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038627    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038630    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038633    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038636    2558 flags.go:64] FLAG: --runonce="false"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038639    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038642    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038645    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038647    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038650    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038653    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038656    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038659    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038662    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038665    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038667    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038671    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038673    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038676    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038679    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038684    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 19:05:18.046788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038686    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038689    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038694    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038697    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038700    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038702    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038705    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038708    2558 flags.go:64] FLAG: --v="2"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038711    2558 flags.go:64] FLAG: --version="false"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038715    2558 flags.go:64] FLAG: --vmodule=""
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038719    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.038722    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038835    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038838    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038841    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038844    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038846    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038848    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038851    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038853    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038856    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038858    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.047465 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038861    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038863    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038866    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038869    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038872    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038874    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038876    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038879    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038881    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038883    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038886    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038888    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038892    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038894    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038897    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038899    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038902    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038904    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038906    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038909    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.047985 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038912    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038914    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038916    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038919    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038921    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038924    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038926    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038928    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038931    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038933    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038935    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038938    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038941    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038943    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038945    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038948    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038950    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038952    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038955    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038957    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.048499 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038960    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038962    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038964    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038967    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038970    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038973    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038975    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038978    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038980    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038983    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038985    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038987    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038991    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038995    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.038998    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039001    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039003    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039006    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039008    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.048993 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039010    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039013    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039015    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039018    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039021    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039024    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039027    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039029    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039032    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039034    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039036    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039039    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039041    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039044    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039046    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039049    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039051    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039055    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039057    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.049475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039060    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039062    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039064    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039067    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039069    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039071    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039074    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039077    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039081    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039084    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.039087    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.039550    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.047479    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.047494    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 19:05:18.049937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.047513    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.047519    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047576    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047581    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047584    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047588    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047591    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047594    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047597    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047600    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047603    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047605    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047608    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047611    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047613    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047616    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047618    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047621    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047624    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.050303 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047627    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047629    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047631    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047634    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047637    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047639    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047642    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047644    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047646    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047649    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047651    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047654    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047657    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047660    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047662    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047665    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047667    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047670    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047672    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047675    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.050772 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047677    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047680    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047682    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047685    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047687    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047690    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047692    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047695    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047697    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047707    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047710    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047712    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047715    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047718    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047720    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047723    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047726    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047731    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047735    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.051271 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047738    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047741    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047744    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047746    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047750    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047753    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047755    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047758    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047761    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047763    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047765    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047768    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047770    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047773    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047775    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047777    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047780    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047782    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047784    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047787    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.051728 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047789    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047792    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047794    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047797    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047799    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047802    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047804    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047807    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047809    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047811    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047814    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047816    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047820    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047823    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047826    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047829    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047831    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047834    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047837    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.052244 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047839    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047841    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047844    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047847    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.047852    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047968    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047973    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047976    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047979    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047981    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047984    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047987    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047989    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047992    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047994    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 19:05:18.052696 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.047997    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048000    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048003    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048006    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048008    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048011    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048013    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048016    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048019    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048022    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048024    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048026    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048029    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048031    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048034    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048036    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048039    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048041    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048044    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 19:05:18.053065 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048046    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048049    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048051    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048053    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048056    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048058    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048061    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048063    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048065    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048068    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048070    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048073    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048076    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048079    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048081    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048083    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048087    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048091    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048095    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048098    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 19:05:18.053545 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048100    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048103    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048105    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048108    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048110    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048112    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048115    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048117    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048120    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048123    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048125    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048128    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048130    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048132    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048135    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048137    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048141    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048144    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048146    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 19:05:18.054032 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048149    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048151    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048154    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048156    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048158    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048161    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048177    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048180    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048183    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048185    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048188    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048191    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048193    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048196    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048198    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048201    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048203    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048206    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048208    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048210    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 19:05:18.054628 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048213    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048215    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048218    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048221    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048223    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048227    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048230    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048234    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048236    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048239    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:18.048241    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.048246    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.048372    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.051817    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 19:05:18.055108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.052951    2558 server.go:1019] "Starting client certificate rotation"
Jul 27 19:05:18.055477 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.053049    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:18.055477 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.053085    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 19:05:18.055477 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.054998    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:18.058554 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.058534    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 19:05:18.065350 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.065335    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 27 19:05:18.069266 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.069246    2558 log.go:25] "Validated CRI v1 image API"
Jul 27 19:05:18.070083 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.070068    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 19:05:18.072219 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.072201    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 98baee3f-c30b-49f7-bb9c-d4329e8a57d6:/dev/nvme0n1p3 dd8b44ba-57e1-42de-acb2-34168025c6a8:/dev/nvme0n1p4]
Jul 27 19:05:18.072259 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.072219    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 19:05:18.078212 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.078025    2558 manager.go:216] Machine: {Timestamp:2026-07-27 19:05:18.076783803 +0000 UTC m=+0.272752882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100118 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21ccba59f9db3e2582f7dc43089c98 SystemUUID:ec21ccba-59f9-db3e-2582-f7dc43089c98 BootID:36145335-6698-48dd-946c-db411f993484 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:e0:dc:c1:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:e0:dc:c1:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:c5:03:dc:41:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 19:05:18.078212 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.078202    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 19:05:18.078349 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.078288    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 19:05:18.080609 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.080578    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 19:05:18.080831 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.080613    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 19:05:18.080899 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.080825    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:18.081338 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.081328    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 19:05:18.081368 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.081342    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 19:05:18.081368 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.081349    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:18.081368 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.081364    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 19:05:18.082200 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.082191    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 19:05:18.084823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084812    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:18.084936 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084927    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 19:05:18.084967 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084961    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 19:05:18.084994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084973    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 19:05:18.084994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084987    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 19:05:18.085048 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.084996    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 27 19:05:18.085048 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.085005    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 19:05:18.085391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.085378    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:18.085429 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.085400    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 19:05:18.087780 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.087763    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 19:05:18.089420 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.089406    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 19:05:18.089459 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.089437    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 19:05:18.090798 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090786    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 19:05:18.090838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090807    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 19:05:18.090838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090815    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 19:05:18.090838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090821    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 19:05:18.090838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090832    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090840    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090852    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090858    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090864    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090869    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090877    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 19:05:18.090940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.090882    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 19:05:18.091458 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.091447    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 19:05:18.091489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.091460    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 19:05:18.095461 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.095410    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 19:05:18.095565 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.095459    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 19:05:18.095565 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.095520    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 19:05:18.095704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.095692    2558 server.go:1268] "Started kubelet"
Jul 27 19:05:18.095789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.095763    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 19:05:18.095843 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.095810    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 19:05:18.095843 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.095773    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 19:05:18.096551 ip-10-0-132-61 systemd[1]: Started Kubernetes Kubelet.
Jul 27 19:05:18.097469 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.097398    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 19:05:18.097678 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.097651    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 19:05:18.099600 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.099584    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 19:05:18.102531 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.102512    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lccdc"
Jul 27 19:05:18.103476 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.103456    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 19:05:18.103476 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.103465    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:18.103675 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.103555    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.104191 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104023    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 19:05:18.104191 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104046    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 19:05:18.104191 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104031    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 19:05:18.104335 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104214    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 19:05:18.104493 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104477    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 19:05:18.104760 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104739    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 19:05:18.104824 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104764    2558 factory.go:55] Registering systemd factory
Jul 27 19:05:18.104824 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.104777    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 27 19:05:18.105118 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.105093    2558 factory.go:153] Registering CRI-O factory
Jul 27 19:05:18.105118 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.105116    2558 factory.go:223] Registration of the crio container factory successfully
Jul 27 19:05:18.105241 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.105138    2558 factory.go:103] Registering Raw factory
Jul 27 19:05:18.105241 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.105181    2558 manager.go:1196] Started watching for new ooms in manager
Jul 27 19:05:18.105620 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.105602    2558 manager.go:349] Starting recovery of all containers
Jul 27 19:05:18.107904 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.107872    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 19:05:18.108279 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.108245    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 19:05:18.111969 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.107994    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-61.ec2.internal.18c63af31a898c7e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-61.ec2.internal,UID:ip-10-0-132-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-61.ec2.internal,},FirstTimestamp:2026-07-27 19:05:18.095666302 +0000 UTC m=+0.291635380,LastTimestamp:2026-07-27 19:05:18.095666302 +0000 UTC m=+0.291635380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-61.ec2.internal,}"
Jul 27 19:05:18.114340 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.114305    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lccdc"
Jul 27 19:05:18.119534 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.119510    2558 manager.go:354] Recovery completed
Jul 27 19:05:18.120756 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.120734    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 27 19:05:18.123670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.123656    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.125907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.125893    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.125967 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.125921    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.125967 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.125932    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.126461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.126449    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 19:05:18.126461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.126459    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 19:05:18.126568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.126475    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 19:05:18.126568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.126513    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.128019 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.128001    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.128128 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.128031    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.128128 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.128066    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.128322 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.128228    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-61.ec2.internal.18c63af31c56fb66  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-61.ec2.internal,UID:ip-10-0-132-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-61.ec2.internal,},FirstTimestamp:2026-07-27 19:05:18.12590679 +0000 UTC m=+0.321875869,LastTimestamp:2026-07-27 19:05:18.12590679 +0000 UTC m=+0.321875869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-61.ec2.internal,}"
Jul 27 19:05:18.129088 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.129077    2558 policy_none.go:49] "None policy: Start"
Jul 27 19:05:18.129132 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.129093    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 19:05:18.129132 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.129105    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 19:05:18.131147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.131134    2558 policy_none.go:47] "Start"
Jul 27 19:05:18.173021 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.172802    2558 manager.go:337] "Starting Device Plugin manager"
Jul 27 19:05:18.173140 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.173049    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 19:05:18.173140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173063    2558 server.go:87] "Starting device plugin registration server"
Jul 27 19:05:18.173389 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173376    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 19:05:18.173484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173391    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 19:05:18.173534 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173488    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 19:05:18.173579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173573    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 19:05:18.173628 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.173582    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 19:05:18.174145 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.174124    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 19:05:18.174244 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.174191    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.241830 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.241783    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 19:05:18.244013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.243192    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 19:05:18.244013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.243226    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 19:05:18.244013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.243246    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 19:05:18.244013 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.243279    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 19:05:18.245719 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.245701    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:18.273781 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.273753    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.274641 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.274626    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.274714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.274654    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.274714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.274665    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.274714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.274686    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.280517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.280500    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.280599 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.280522    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-61.ec2.internal\": node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.298017 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.297959    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.343478 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.343452    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"]
Jul 27 19:05:18.343597 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.343511    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.345026 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.345009    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.345114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.345039    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.345114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.345053    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.347427 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.347414    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.347546 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.347532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.347584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.347560    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.348108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348091    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.348193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348122    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.348193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348150    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.348193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348162    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.348193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348125    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.348376 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.348217    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.350542 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.350521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.350619 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.350555    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 19:05:18.351229 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.351216    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 19:05:18.351294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.351243    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 19:05:18.351294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.351256    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeHasSufficientPID"
Jul 27 19:05:18.368889 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.368865    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-61.ec2.internal\" not found" node="ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.373222 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.373205    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-61.ec2.internal\" not found" node="ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.399063 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.399038    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.407193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.407152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da79ada79033cdf20af7c0b236d8437a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-61.ec2.internal\" (UID: \"da79ada79033cdf20af7c0b236d8437a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.407265 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.407207    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.407265 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.407232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.499567 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.499537    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.507948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.507922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da79ada79033cdf20af7c0b236d8437a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-61.ec2.internal\" (UID: \"da79ada79033cdf20af7c0b236d8437a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.507998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.507954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.507998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.507974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.508061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.508030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.508061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.508030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da79ada79033cdf20af7c0b236d8437a-config\") pod \"kube-apiserver-proxy-ip-10-0-132-61.ec2.internal\" (UID: \"da79ada79033cdf20af7c0b236d8437a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.508061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.508052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd4b797e6dae014084d6ea1c68fbfe05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal\" (UID: \"bd4b797e6dae014084d6ea1c68fbfe05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.600354 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.600285    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.671829 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.671797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.677017 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:18.676032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:18.701148 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.701116    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.801648 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.801610    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:18.902216 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:18.902135    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.002742 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:19.002711    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.053191 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.053150    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 19:05:19.053585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.053307    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 19:05:19.102798 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:19.102767    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.121607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.121572    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:00:18 +0000 UTC" deadline="2028-04-24 11:11:33.397669728 +0000 UTC"
Jul 27 19:05:19.121607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.121606    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15280h6m14.276067677s"
Jul 27 19:05:19.202866 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:19.202837    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.277840 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:19.277804    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda79ada79033cdf20af7c0b236d8437a.slice/crio-593bce856f62eec030bf00ef78a24baf08e873af45f90ca90b0e8bc8635672a3 WatchSource:0}: Error finding container 593bce856f62eec030bf00ef78a24baf08e873af45f90ca90b0e8bc8635672a3: Status 404 returned error can't find the container with id 593bce856f62eec030bf00ef78a24baf08e873af45f90ca90b0e8bc8635672a3
Jul 27 19:05:19.282285 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.282271    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:05:19.303579 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:19.303559    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.311396 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:19.311369    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4b797e6dae014084d6ea1c68fbfe05.slice/crio-a2883c55e083e894302e5c841c5f1760a6e2cf65cfaf886fa8e030c6625b4669 WatchSource:0}: Error finding container a2883c55e083e894302e5c841c5f1760a6e2cf65cfaf886fa8e030c6625b4669: Status 404 returned error can't find the container with id a2883c55e083e894302e5c841c5f1760a6e2cf65cfaf886fa8e030c6625b4669
Jul 27 19:05:19.403883 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:19.403840    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-61.ec2.internal\" not found"
Jul 27 19:05:19.434112 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.434059    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:19.506815 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.506764    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:19.510987 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.510968    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:19.517386 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.517370    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:19.519140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.519126    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"
Jul 27 19:05:19.529936 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.529919    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 19:05:19.643375 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:19.643346    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:20.085540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.085503    2558 apiserver.go:52] "Watching apiserver"
Jul 27 19:05:20.091421 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.091399    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 19:05:20.093430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.093401    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-zk2c4","openshift-ovn-kubernetes/ovnkube-node-4tspv","kube-system/konnectivity-agent-xhgtk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr","openshift-cluster-node-tuning-operator/tuned-zmx56","openshift-dns/node-resolver-lq65n","openshift-multus/multus-additional-cni-plugins-75z5h","openshift-multus/multus-gcrkv","openshift-multus/network-metrics-daemon-df7k9","openshift-network-diagnostics/network-check-target-lpxqb","kube-system/global-pull-secret-syncer-5c8wf","kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal","openshift-image-registry/node-ca-xzcw7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal"]
Jul 27 19:05:20.096216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.096190    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.098495 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.098473    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 19:05:20.099043 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099025    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 19:05:20.099180 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2lmcz\""
Jul 27 19:05:20.099274 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099023    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 19:05:20.099388 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099371    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.099506 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099486    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.099608 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.099592    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.101806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.101778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 19:05:20.102630 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.102611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.104022 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.103309    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.104022 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.103332    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.104022 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.103409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9k8bt\""
Jul 27 19:05:20.104266 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.104243    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 19:05:20.105098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.105079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.106020 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.106000    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 19:05:20.106113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.106094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8dcc\""
Jul 27 19:05:20.106289 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.106259    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 19:05:20.115472 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.115445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.115576 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.115476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.115643 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.115590    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:20.115977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.115953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.116876 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.116844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.117358 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117334    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.117458 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117341    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 19:05:20.117505 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117487    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.117612 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117593    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b6vjb\""
Jul 27 19:05:20.117612 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-cnibin\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.117687 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.117722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4gjs\" (UniqueName: \"kubernetes.io/projected/9f4a232b-038d-4339-b4c6-47d834944aab-kube-api-access-h4gjs\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.117759 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117722    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94b09010-04b5-455f-8ba8-a64d0a523287-agent-certs\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.117796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysconfig\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.117796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117788    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.117871 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-systemd\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.117993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-conf\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-binary-copy\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-tmp\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-os-release\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-sys\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-tuned\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgd4f\" (UniqueName: \"kubernetes.io/projected/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-kube-api-access-zgd4f\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4a232b-038d-4339-b4c6-47d834944aab-host\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm74z\" (UniqueName: \"kubernetes.io/projected/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kube-api-access-sm74z\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.118549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94b09010-04b5-455f-8ba8-a64d0a523287-konnectivity-ca\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4a232b-038d-4339-b4c6-47d834944aab-serviceca\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-kubernetes\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-run\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-lib-modules\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-host\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8plh\" (UniqueName: \"kubernetes.io/projected/aa929aef-a9d7-44c4-8760-9544afcc6468-kube-api-access-r8plh\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-modprobe-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118889    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118895    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.118943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-var-lib-kubelet\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.118958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-system-cni-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119136    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119241    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ws6vn\""
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119476    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xt2gt\""
Jul 27 19:05:20.119585 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119539    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.120041 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119749    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 19:05:20.120041 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.119766    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.120159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.120046    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgxf9\""
Jul 27 19:05:20.128640 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.128616    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.130843 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.130459    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:20.130843 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.130540    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:20.130997 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.130921    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.131852    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132283    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132438    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132484    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pv96r\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132492    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132762    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 19:05:20.133424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.132931    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 19:05:20.135093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.135053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.135186 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.135125    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:20.137933 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.137407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.140045 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.140026    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbbqc\""
Jul 27 19:05:20.140582 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.140027    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 19:05:20.170393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.170369    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4zqj6"
Jul 27 19:05:20.176952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.176931    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4zqj6"
Jul 27 19:05:20.205815 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.205795    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 19:05:20.219519 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-k8s-cni-cncf-io\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-bin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-kubelet\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-node-log\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.219631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:20.219631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-cni-binary-copy\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-os-release\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-kubernetes\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-run\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-lib-modules\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-netd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-var-lib-kubelet\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-netns\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-hostroot\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-etc-kubernetes\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.219905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-systemd-units\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94b09010-04b5-455f-8ba8-a64d0a523287-agent-certs\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.219976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-log-socket\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-bin\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-systemd\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29182328-58c8-4cd0-86b8-0b7685950f0b-host-slash\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-config\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-conf\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-slash\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-tmp\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-os-release\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4989\" (UniqueName: \"kubernetes.io/projected/29182328-58c8-4cd0-86b8-0b7685950f0b-kube-api-access-n4989\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-system-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-kubelet\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.220507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-netns\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-sys\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-tuned\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgd4f\" (UniqueName: \"kubernetes.io/projected/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-kube-api-access-zgd4f\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-tmp-dir\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220522    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-var-lib-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-ovn\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-conf-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn74t\" (UniqueName: \"kubernetes.io/projected/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-kube-api-access-tn74t\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4a232b-038d-4339-b4c6-47d834944aab-serviceca\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-host\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8plh\" (UniqueName: \"kubernetes.io/projected/aa929aef-a9d7-44c4-8760-9544afcc6468-kube-api-access-r8plh\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-daemon-config\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.221355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-modprobe-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-system-cni-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.220983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-cnibin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221008    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-multus\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzkl\" (UniqueName: \"kubernetes.io/projected/38f1843c-109c-4cbb-9802-2af5fb27a19d-kube-api-access-vfzkl\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-cnibin\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4gjs\" (UniqueName: \"kubernetes.io/projected/9f4a232b-038d-4339-b4c6-47d834944aab-kube-api-access-h4gjs\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-hosts-file\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-etc-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysconfig\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-systemd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221324    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-env-overrides\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221342    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-kubernetes\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-run\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-lib-modules\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-var-lib-kubelet\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-registration-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-sys\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.221349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-script-lib\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-binary-copy\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m7wj\" (UniqueName: \"kubernetes.io/projected/60fda6fc-1f8e-4132-83ab-43632e72b4ea-kube-api-access-9m7wj\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-dbus\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-multus-certs\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovn-node-metrics-cert\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-system-cni-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.222857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4a232b-038d-4339-b4c6-47d834944aab-host\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f4a232b-038d-4339-b4c6-47d834944aab-host\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm74z\" (UniqueName: \"kubernetes.io/projected/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kube-api-access-sm74z\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-kubelet-config\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrn6r\" (UniqueName: \"kubernetes.io/projected/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-kube-api-access-nrn6r\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94b09010-04b5-455f-8ba8-a64d0a523287-konnectivity-ca\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29182328-58c8-4cd0-86b8-0b7685950f0b-iptables-alerter-script\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-socket-dir-parent\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-systemd\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-device-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-sys-fs\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-tuning-conf-dir\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-socket-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.222773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-conf\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.223806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.223686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-cnibin\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.223840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-binary-copy\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.223899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa929aef-a9d7-44c4-8760-9544afcc6468-os-release\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.223905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-modprobe-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-host\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-etc-selinux\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysconfig\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f4a232b-038d-4339-b4c6-47d834944aab-serviceca\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-sysctl-d\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa929aef-a9d7-44c4-8760-9544afcc6468-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.224680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94b09010-04b5-455f-8ba8-a64d0a523287-konnectivity-ca\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.226185 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.225042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-etc-tuned\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.226967 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.226231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-tmp\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.228008 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.227951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94b09010-04b5-455f-8ba8-a64d0a523287-agent-certs\") pod \"konnectivity-agent-xhgtk\" (UID: \"94b09010-04b5-455f-8ba8-a64d0a523287\") " pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.231676 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.231653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgd4f\" (UniqueName: \"kubernetes.io/projected/2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f-kube-api-access-zgd4f\") pod \"tuned-zmx56\" (UID: \"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f\") " pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.232829 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.232804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8plh\" (UniqueName: \"kubernetes.io/projected/aa929aef-a9d7-44c4-8760-9544afcc6468-kube-api-access-r8plh\") pod \"multus-additional-cni-plugins-75z5h\" (UID: \"aa929aef-a9d7-44c4-8760-9544afcc6468\") " pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.234487 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.234464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm74z\" (UniqueName: \"kubernetes.io/projected/0b25a2de-ef2e-4502-8e15-d2168ebd7f8f-kube-api-access-sm74z\") pod \"aws-ebs-csi-driver-node-jx5hr\" (UID: \"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.235958 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.235933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4gjs\" (UniqueName: \"kubernetes.io/projected/9f4a232b-038d-4339-b4c6-47d834944aab-kube-api-access-h4gjs\") pod \"node-ca-xzcw7\" (UID: \"9f4a232b-038d-4339-b4c6-47d834944aab\") " pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.248901 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.248213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal" event={"ID":"bd4b797e6dae014084d6ea1c68fbfe05","Type":"ContainerStarted","Data":"a2883c55e083e894302e5c841c5f1760a6e2cf65cfaf886fa8e030c6625b4669"}
Jul 27 19:05:20.250517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.250489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal" event={"ID":"da79ada79033cdf20af7c0b236d8437a","Type":"ContainerStarted","Data":"593bce856f62eec030bf00ef78a24baf08e873af45f90ca90b0e8bc8635672a3"}
Jul 27 19:05:20.323042 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29182328-58c8-4cd0-86b8-0b7685950f0b-host-slash\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-config\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-slash\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4989\" (UniqueName: \"kubernetes.io/projected/29182328-58c8-4cd0-86b8-0b7685950f0b-kube-api-access-n4989\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323214    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-system-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-system-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.323299    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-slash\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.323377    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:20.823352922 +0000 UTC m=+3.019321992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-kubelet\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-netns\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29182328-58c8-4cd0-86b8-0b7685950f0b-host-slash\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-tmp-dir\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-kubelet\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-var-lib-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-ovn\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.325318 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-netns\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-conf-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-conf-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-var-lib-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.323757    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-ovn\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn74t\" (UniqueName: \"kubernetes.io/projected/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-kube-api-access-tn74t\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.323804    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:20.823787738 +0000 UTC m=+3.019756820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-daemon-config\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-config\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-cnibin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-cnibin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-tmp-dir\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.323988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-multus\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-multus\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzkl\" (UniqueName: \"kubernetes.io/projected/38f1843c-109c-4cbb-9802-2af5fb27a19d-kube-api-access-vfzkl\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.326147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-cni-dir\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-hosts-file\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324097    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-etc-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-systemd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-env-overrides\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-etc-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324228    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-script-lib\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-systemd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-hosts-file\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m7wj\" (UniqueName: \"kubernetes.io/projected/60fda6fc-1f8e-4132-83ab-43632e72b4ea-kube-api-access-9m7wj\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-dbus\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-multus-certs\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovn-node-metrics-cert\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-kubelet-config\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrn6r\" (UniqueName: \"kubernetes.io/projected/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-kube-api-access-nrn6r\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29182328-58c8-4cd0-86b8-0b7685950f0b-iptables-alerter-script\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-socket-dir-parent\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-k8s-cni-cncf-io\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-kubelet-config\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-bin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-kubelet\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-cni-bin\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-node-log\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-cni-binary-copy\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-os-release\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-netd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-netns\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovnkube-script-lib\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-hostroot\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.327764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-etc-kubernetes\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-systemd-units\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-socket-dir-parent\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-log-socket\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-run-openvswitch\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-bin\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-multus-certs\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.324394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-multus-daemon-config\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-k8s-cni-cncf-io\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33c330a1-7274-45b0-9753-cd623bc66ee7-dbus\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-os-release\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-netd\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-run-netns\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/60fda6fc-1f8e-4132-83ab-43632e72b4ea-env-overrides\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-node-log\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-host-var-lib-kubelet\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-systemd-units\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-etc-kubernetes\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.328499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325509    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29182328-58c8-4cd0-86b8-0b7685950f0b-iptables-alerter-script\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.329110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-host-cni-bin\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.329110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/60fda6fc-1f8e-4132-83ab-43632e72b4ea-log-socket\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.329110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/38f1843c-109c-4cbb-9802-2af5fb27a19d-hostroot\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.329110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.325909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38f1843c-109c-4cbb-9802-2af5fb27a19d-cni-binary-copy\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.329110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.328139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/60fda6fc-1f8e-4132-83ab-43632e72b4ea-ovn-node-metrics-cert\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.331299 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.331274    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:20.331419 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.331305    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:20.331419 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.331322    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:20.331583 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.331568    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:20.831547834 +0000 UTC m=+3.027516914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:20.333301 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.333273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4989\" (UniqueName: \"kubernetes.io/projected/29182328-58c8-4cd0-86b8-0b7685950f0b-kube-api-access-n4989\") pod \"iptables-alerter-zk2c4\" (UID: \"29182328-58c8-4cd0-86b8-0b7685950f0b\") " pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.333457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.333429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn74t\" (UniqueName: \"kubernetes.io/projected/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-kube-api-access-tn74t\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.334171 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.334147    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrn6r\" (UniqueName: \"kubernetes.io/projected/c534fe2f-60b6-4a0a-bd85-520e1e6ed07f-kube-api-access-nrn6r\") pod \"node-resolver-lq65n\" (UID: \"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f\") " pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.334433 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.334414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m7wj\" (UniqueName: \"kubernetes.io/projected/60fda6fc-1f8e-4132-83ab-43632e72b4ea-kube-api-access-9m7wj\") pod \"ovnkube-node-4tspv\" (UID: \"60fda6fc-1f8e-4132-83ab-43632e72b4ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.334511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.334468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzkl\" (UniqueName: \"kubernetes.io/projected/38f1843c-109c-4cbb-9802-2af5fb27a19d-kube-api-access-vfzkl\") pod \"multus-gcrkv\" (UID: \"38f1843c-109c-4cbb-9802-2af5fb27a19d\") " pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.429061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.428814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-75z5h"
Jul 27 19:05:20.439898 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.439874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xzcw7"
Jul 27 19:05:20.453816 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.453789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:20.460609 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.460585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr"
Jul 27 19:05:20.471428 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.471406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zmx56"
Jul 27 19:05:20.478331 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.478313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lq65n"
Jul 27 19:05:20.487155 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.487136    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zk2c4"
Jul 27 19:05:20.496082 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.496060    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:20.501925 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.501908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcrkv"
Jul 27 19:05:20.614180 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.614150    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 19:05:20.828630 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.828543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:20.828630 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.828599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:20.828868 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.828725    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:20.828868 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.828736    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:20.828868 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.828813    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:21.8287934 +0000 UTC m=+4.024762472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:20.828868 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.828829    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:21.828822385 +0000 UTC m=+4.024791453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:20.929680 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:20.929646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:20.929866 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.929840    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:20.929866 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.929864    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:20.929986 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.929877    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:20.929986 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:20.929947    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:21.929925464 +0000 UTC m=+4.125894533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:21.181095 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:21.180992    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:20 +0000 UTC" deadline="2028-04-08 18:58:10.741848192 +0000 UTC"
Jul 27 19:05:21.181095 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:21.181046    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14903h52m49.56080589s"
Jul 27 19:05:21.345529 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.345507    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc534fe2f_60b6_4a0a_bd85_520e1e6ed07f.slice/crio-ca62f8886c57cfaeef3ab2e6390cfaa62a9c0bf298e1e0d8037d0d724a23ce80 WatchSource:0}: Error finding container ca62f8886c57cfaeef3ab2e6390cfaa62a9c0bf298e1e0d8037d0d724a23ce80: Status 404 returned error can't find the container with id ca62f8886c57cfaeef3ab2e6390cfaa62a9c0bf298e1e0d8037d0d724a23ce80
Jul 27 19:05:21.346877 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.346851    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fda6fc_1f8e_4132_83ab_43632e72b4ea.slice/crio-24e0d31cdc3f81f13e642c1ee08cd2f9fe08bbe2b7c01e09466bfca557fe8ad2 WatchSource:0}: Error finding container 24e0d31cdc3f81f13e642c1ee08cd2f9fe08bbe2b7c01e09466bfca557fe8ad2: Status 404 returned error can't find the container with id 24e0d31cdc3f81f13e642c1ee08cd2f9fe08bbe2b7c01e09466bfca557fe8ad2
Jul 27 19:05:21.368764 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.368737    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4a232b_038d_4339_b4c6_47d834944aab.slice/crio-f43e89a53197ee2fa89db5cf58080f7489245ed312156bc87d3fea6151ce14df WatchSource:0}: Error finding container f43e89a53197ee2fa89db5cf58080f7489245ed312156bc87d3fea6151ce14df: Status 404 returned error can't find the container with id f43e89a53197ee2fa89db5cf58080f7489245ed312156bc87d3fea6151ce14df
Jul 27 19:05:21.369817 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.369760    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd8ec05_f7e9_49ef_9d9f_55e1a888a17f.slice/crio-ebfe7ca1132f6eb7aa9ceb74f42c785a002c2ca70febbad8953b0d8043eead93 WatchSource:0}: Error finding container ebfe7ca1132f6eb7aa9ceb74f42c785a002c2ca70febbad8953b0d8043eead93: Status 404 returned error can't find the container with id ebfe7ca1132f6eb7aa9ceb74f42c785a002c2ca70febbad8953b0d8043eead93
Jul 27 19:05:21.372984 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.372940    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b25a2de_ef2e_4502_8e15_d2168ebd7f8f.slice/crio-12e95180dc20daa24397545623be911eebbadf2aa53253ad35a2d8ce2213fc78 WatchSource:0}: Error finding container 12e95180dc20daa24397545623be911eebbadf2aa53253ad35a2d8ce2213fc78: Status 404 returned error can't find the container with id 12e95180dc20daa24397545623be911eebbadf2aa53253ad35a2d8ce2213fc78
Jul 27 19:05:21.373725 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.373700    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b09010_04b5_455f_8ba8_a64d0a523287.slice/crio-558eb85c82b3da0e89ee6aff38bc352090d83bf9afeda17df9a581f897966209 WatchSource:0}: Error finding container 558eb85c82b3da0e89ee6aff38bc352090d83bf9afeda17df9a581f897966209: Status 404 returned error can't find the container with id 558eb85c82b3da0e89ee6aff38bc352090d83bf9afeda17df9a581f897966209
Jul 27 19:05:21.375238 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.375216    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa929aef_a9d7_44c4_8760_9544afcc6468.slice/crio-28d2811729590dc77975043c620c6052be4be1ddf2f0521ec0e069b1276be687 WatchSource:0}: Error finding container 28d2811729590dc77975043c620c6052be4be1ddf2f0521ec0e069b1276be687: Status 404 returned error can't find the container with id 28d2811729590dc77975043c620c6052be4be1ddf2f0521ec0e069b1276be687
Jul 27 19:05:21.376429 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:21.376406    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29182328_58c8_4cd0_86b8_0b7685950f0b.slice/crio-c4c2b048936df0542b64f18c7d67a6d73afb78a46f995253d984e61e4546ddc6 WatchSource:0}: Error finding container c4c2b048936df0542b64f18c7d67a6d73afb78a46f995253d984e61e4546ddc6: Status 404 returned error can't find the container with id c4c2b048936df0542b64f18c7d67a6d73afb78a46f995253d984e61e4546ddc6
Jul 27 19:05:21.837859 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:21.837500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:21.838054 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:21.837877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:21.838054 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.837662    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:21.838054 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.838050    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.838031762 +0000 UTC m=+6.034000830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:21.838426 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.837986    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:21.838555 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.838475    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.838455417 +0000 UTC m=+6.034424485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:21.939086 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:21.938234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:21.939086 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.938616    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:21.939086 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.938644    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:21.939086 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.938657    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:21.939086 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:21.938718    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:23.93869897 +0000 UTC m=+6.134668044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:22.183452 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.181950    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:00:20 +0000 UTC" deadline="2028-03-01 16:38:10.573420269 +0000 UTC"
Jul 27 19:05:22.183452 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.182009    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13989h32m48.391415839s"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.244260    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:22.244394    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.244494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:22.244592    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.244657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:22.247631 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:22.244732    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:22.278172 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.278109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal" event={"ID":"da79ada79033cdf20af7c0b236d8437a","Type":"ContainerStarted","Data":"6143e77e78d054ceb2ab777e3e3ed7b8495b03fbc67871b3fa87a4b6392793bc"}
Jul 27 19:05:22.289757 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.289690    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerStarted","Data":"28d2811729590dc77975043c620c6052be4be1ddf2f0521ec0e069b1276be687"}
Jul 27 19:05:22.293448 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.293395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zk2c4" event={"ID":"29182328-58c8-4cd0-86b8-0b7685950f0b","Type":"ContainerStarted","Data":"c4c2b048936df0542b64f18c7d67a6d73afb78a46f995253d984e61e4546ddc6"}
Jul 27 19:05:22.296190 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.296158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr" event={"ID":"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f","Type":"ContainerStarted","Data":"12e95180dc20daa24397545623be911eebbadf2aa53253ad35a2d8ce2213fc78"}
Jul 27 19:05:22.298647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.298154    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-61.ec2.internal" podStartSLOduration=3.298136629 podStartE2EDuration="3.298136629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:22.297390864 +0000 UTC m=+4.493359957" watchObservedRunningTime="2026-07-27 19:05:22.298136629 +0000 UTC m=+4.494105725"
Jul 27 19:05:22.307384 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.307307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzcw7" event={"ID":"9f4a232b-038d-4339-b4c6-47d834944aab","Type":"ContainerStarted","Data":"f43e89a53197ee2fa89db5cf58080f7489245ed312156bc87d3fea6151ce14df"}
Jul 27 19:05:22.334473 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.334189    2558 generic.go:356] "Generic (PLEG): container finished" podID="bd4b797e6dae014084d6ea1c68fbfe05" containerID="ac82b72c955a606042323bd87ed95746cc875a95a840943ed128566ec98669ca" exitCode=0
Jul 27 19:05:22.334473 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.334303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal" event={"ID":"bd4b797e6dae014084d6ea1c68fbfe05","Type":"ContainerDied","Data":"ac82b72c955a606042323bd87ed95746cc875a95a840943ed128566ec98669ca"}
Jul 27 19:05:22.337614 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.337586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhgtk" event={"ID":"94b09010-04b5-455f-8ba8-a64d0a523287","Type":"ContainerStarted","Data":"558eb85c82b3da0e89ee6aff38bc352090d83bf9afeda17df9a581f897966209"}
Jul 27 19:05:22.346449 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.346422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcrkv" event={"ID":"38f1843c-109c-4cbb-9802-2af5fb27a19d","Type":"ContainerStarted","Data":"87d5dcd7c71d41713e59f1ac839598a6f86c98efe829f555d15f50a18bad11be"}
Jul 27 19:05:22.355001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.354938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zmx56" event={"ID":"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f","Type":"ContainerStarted","Data":"ebfe7ca1132f6eb7aa9ceb74f42c785a002c2ca70febbad8953b0d8043eead93"}
Jul 27 19:05:22.361978 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.361949    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"24e0d31cdc3f81f13e642c1ee08cd2f9fe08bbe2b7c01e09466bfca557fe8ad2"}
Jul 27 19:05:22.366485 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:22.366461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lq65n" event={"ID":"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f","Type":"ContainerStarted","Data":"ca62f8886c57cfaeef3ab2e6390cfaa62a9c0bf298e1e0d8037d0d724a23ce80"}
Jul 27 19:05:23.388609 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:23.388324    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal" event={"ID":"bd4b797e6dae014084d6ea1c68fbfe05","Type":"ContainerStarted","Data":"8be88989362e0c70a4569b88d8bc0e0daee91ff6760aee6db950cde884ff6103"}
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:23.857875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:23.857993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.858128    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.858192    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:27.858172801 +0000 UTC m=+10.054141890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.858664    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:23.858823 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.858735    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:27.858718446 +0000 UTC m=+10.054687517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:23.959835 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:23.959057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:23.959835 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.959312    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:23.959835 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.959334    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:23.959835 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.959348    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:23.959835 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:23.959410    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:27.959389991 +0000 UTC m=+10.155359061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:24.249366 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:24.249276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:24.249537 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:24.249428    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:24.249915 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:24.249877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:24.250028 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:24.250001    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:24.250094 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:24.250071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:24.250169 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:24.250148    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:26.244507 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:26.244277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:26.245054 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:26.244644    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:26.245054 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:26.244344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:26.245054 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:26.244741    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:26.245054 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:26.244320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:26.245054 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:26.244836    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:27.894994    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:27.895097    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.895241    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.895309    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:35.895288681 +0000 UTC m=+18.091257767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.895373    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:27.895721 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.895408    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:35.895396443 +0000 UTC m=+18.091365511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:27.997013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:27.996445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:27.997013 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.996641    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:27.997013 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.996663    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:27.997013 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.996675    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:27.997013 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:27.996729    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:35.996711839 +0000 UTC m=+18.192680909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:28.244360 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:28.244286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:28.244360 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:28.244310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:28.246430 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:28.245404    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:28.246430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:28.245730    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:28.246430 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:28.245823    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:28.246430 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:28.245931    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:30.243794 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:30.243766    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:30.244258 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:30.243875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:30.244258 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:30.243878    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:30.244258 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:30.243988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:30.244258 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:30.243771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:30.244258 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:30.244073    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:32.244480 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:32.244437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:32.245076 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:32.244451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:32.245076 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:32.244561    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:32.245076 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:32.244683    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:32.245076 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:32.244715    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:32.245076 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:32.244779    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:34.243607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:34.243570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:34.244011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:34.243570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:34.244011 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:34.243688    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:34.244011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:34.243730    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:34.244011 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:34.243833    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:34.244011 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:34.243928    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:35.959140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:35.959103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:35.959140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:35.959143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:35.959731 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:35.959340    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:35.959731 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:35.959345    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:35.959731 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:35.959415    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:51.959392734 +0000 UTC m=+34.155361844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:35.959731 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:35.959435    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:51.959426544 +0000 UTC m=+34.155395609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:36.059881 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:36.059841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:36.060050 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.059999    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:36.060050 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.060023    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:36.060050 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.060034    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:36.060669 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.060627    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:52.060578219 +0000 UTC m=+34.256547299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:36.244296 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:36.244268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:36.244475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:36.244268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:36.244475 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.244396    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:36.244475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:36.244274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:36.244475 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.244465    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:36.244659 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:36.244538    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:38.244989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:38.244960    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:38.245466 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:38.245073    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:38.245466 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:38.245163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:38.245466 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:38.245288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:38.245466 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:38.245313    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:38.245466 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:38.245360    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:40.243728 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:40.243684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:40.244202 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:40.243809    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:40.244282 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:40.244248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:40.244552 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:40.244330    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:40.244552 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:40.244393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:40.244552 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:40.244514    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:41.428196 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.427812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhgtk" event={"ID":"94b09010-04b5-455f-8ba8-a64d0a523287","Type":"ContainerStarted","Data":"79eae338fab5d153b4a717212da2bc509a54e8f5047ea4c3b87666dc41f5d007"}
Jul 27 19:05:41.429364 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.429340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcrkv" event={"ID":"38f1843c-109c-4cbb-9802-2af5fb27a19d","Type":"ContainerStarted","Data":"c985b9af725b7dc9f7ac3db3f5b1f6bdf53062801ec68bf87b6dac068f987b67"}
Jul 27 19:05:41.430713 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.430678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zmx56" event={"ID":"2fd8ec05-f7e9-49ef-9d9f-55e1a888a17f","Type":"ContainerStarted","Data":"05f085922405c7b3583d0a10ee7d02141d0fd7935a48c6b5d84ba16734d670c9"}
Jul 27 19:05:41.433604 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"46cf86d5e6d473dfcffab0f85e50968347b71418a5cff9869366be51487c4bd7"}
Jul 27 19:05:41.433711 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"8b86924bae20246c29c83de5a0030867ffed0e0c37d55581bbbcd9b8a5b1c48c"}
Jul 27 19:05:41.433711 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"11c24490330b2eb8db683653e56793543d31b54dd24277cde285c6dcad8da263"}
Jul 27 19:05:41.433796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"018325e7a46b08e6a459cec26d7f3d53960ce587b47cd553fad9117e18774104"}
Jul 27 19:05:41.433854 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"b51738170e597c1581d80f8845abc0db3e6129bdb4ff9b078f813c0b4ecd9436"}
Jul 27 19:05:41.433854 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.433831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"fe2d8210388b16db207c0d7e2b31f5e37cf94d9ddeef7f3ae5d324511f2d830f"}
Jul 27 19:05:41.435061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.435039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lq65n" event={"ID":"c534fe2f-60b6-4a0a-bd85-520e1e6ed07f","Type":"ContainerStarted","Data":"839aa32c8cbb0c32e438cb70e5d29caca3423ae14f63d87db64b16a984304d9f"}
Jul 27 19:05:41.439268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.439200    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="802fdc7ebdfdc693a9be5f84aa9bce117074478b8ad3bae6f078f3f1a6b58b4e" exitCode=0
Jul 27 19:05:41.439400 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.439381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"802fdc7ebdfdc693a9be5f84aa9bce117074478b8ad3bae6f078f3f1a6b58b4e"}
Jul 27 19:05:41.442782 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.441921    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xhgtk" podStartSLOduration=4.245315063 podStartE2EDuration="23.441892023s" totalImagesPullingTime="19.19657696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.441453382 +0000 UTC m=+23.637422470" watchObservedRunningTime="2026-07-27 19:05:41.441892023 +0000 UTC m=+23.637861112"
Jul 27 19:05:41.442782 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.442523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr" event={"ID":"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f","Type":"ContainerStarted","Data":"578308fe487c8c22ccc51d6005c6422e62ca8136a1879fb56e5a51e7cefa5872"}
Jul 27 19:05:41.442782 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.442627    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-61.ec2.internal" podStartSLOduration=22.442618366 podStartE2EDuration="22.442618366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:23.40839981 +0000 UTC m=+5.604368903" watchObservedRunningTime="2026-07-27 19:05:41.442618366 +0000 UTC m=+23.638587455"
Jul 27 19:05:41.444347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.444318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xzcw7" event={"ID":"9f4a232b-038d-4339-b4c6-47d834944aab","Type":"ContainerStarted","Data":"1cf4a25f701dc462d7272b3b4e00cb5bc4d5537eb81c11a9b197a58d92d58de6"}
Jul 27 19:05:41.473422 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.473369    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lq65n" podStartSLOduration=4.259248022 podStartE2EDuration="23.47335059s" totalImagesPullingTime="19.214102568s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.473198463 +0000 UTC m=+23.669167545" watchObservedRunningTime="2026-07-27 19:05:41.47335059 +0000 UTC m=+23.669319677"
Jul 27 19:05:41.489239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.489187    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gcrkv" podStartSLOduration=4.242056958 podStartE2EDuration="23.489150887s" totalImagesPullingTime="19.247093929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.488484508 +0000 UTC m=+23.684453598" watchObservedRunningTime="2026-07-27 19:05:41.489150887 +0000 UTC m=+23.685119976"
Jul 27 19:05:41.503014 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.502969    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zmx56" podStartSLOduration=4.294073414 podStartE2EDuration="23.502955637s" totalImagesPullingTime="19.208882223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.502633016 +0000 UTC m=+23.698602105" watchObservedRunningTime="2026-07-27 19:05:41.502955637 +0000 UTC m=+23.698924725"
Jul 27 19:05:41.516152 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:41.516115    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xzcw7" podStartSLOduration=4.313410682 podStartE2EDuration="23.516104604s" totalImagesPullingTime="19.202693922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:41.51537637 +0000 UTC m=+23.711345461" watchObservedRunningTime="2026-07-27 19:05:41.516104604 +0000 UTC m=+23.712073692"
Jul 27 19:05:42.045246 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.045225    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 19:05:42.188411 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.188189    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:05:42.045241745Z","UUID":"4920ffe5-e1b1-4537-918a-09d6191e7f6f","Handler":null,"Name":"","Endpoint":""}
Jul 27 19:05:42.189844 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.189810    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 19:05:42.189959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.189854    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 19:05:42.247447 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.247416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:42.247587 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.247480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:42.247587 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.247501    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:42.247587 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:42.247568    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:42.247763 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:42.247635    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:42.247763 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:42.247733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:42.448354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.448267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zk2c4" event={"ID":"29182328-58c8-4cd0-86b8-0b7685950f0b","Type":"ContainerStarted","Data":"53d1e4eedf2ce4e686ebab814f7e61616556a0ee7a39633f678d80a8f77666a9"}
Jul 27 19:05:42.450491 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.450461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr" event={"ID":"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f","Type":"ContainerStarted","Data":"78d01e13ba83cab5fd6c8658373faed1437d81b876f7074e40603564ad1b4af0"}
Jul 27 19:05:42.462733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:42.462690    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zk2c4" podStartSLOduration=5.271997914 podStartE2EDuration="24.462676507s" totalImagesPullingTime="19.190678593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:42.462273758 +0000 UTC m=+24.658242846" watchObservedRunningTime="2026-07-27 19:05:42.462676507 +0000 UTC m=+24.658645594"
Jul 27 19:05:43.456588 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:43.456508    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr" event={"ID":"0b25a2de-ef2e-4502-8e15-d2168ebd7f8f","Type":"ContainerStarted","Data":"148fb1374e123812a9464bdc9365649645ce98b91c06189697cb51e6f7c44e61"}
Jul 27 19:05:43.475951 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:43.475911    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jx5hr" podStartSLOduration=4.057491507 podStartE2EDuration="25.475891675s" totalImagesPullingTime="21.418400168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:43.475624868 +0000 UTC m=+25.671593959" watchObservedRunningTime="2026-07-27 19:05:43.475891675 +0000 UTC m=+25.671860764"
Jul 27 19:05:44.244021 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:44.243794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:44.244198 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:44.244119    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:44.244198 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:44.243875    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:44.244289 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:44.244231    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:44.244289 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:44.243807    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:44.244350 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:44.244292    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:44.461925 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:44.461873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"973a1956130dc2e84b9aeed54b2c8d8c11b392517f44b50ea60b5a16cf5489c5"}
Jul 27 19:05:45.303646 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:45.303610    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:45.304290 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:45.304268    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:45.464112 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:45.464085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:45.464630 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:45.464579    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xhgtk"
Jul 27 19:05:46.243673 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.243513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:46.243812 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.243562    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:46.243882 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.243567    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:46.243882 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:46.243869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:46.243959 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:46.243747    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:46.244000 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:46.243949    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:46.467117 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.467083    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="b1b34a85aef4f3250fc75cd8c295a380d564c8fd23372b34f20c72c2442ddbd8" exitCode=0
Jul 27 19:05:46.467915 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.467186    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"b1b34a85aef4f3250fc75cd8c295a380d564c8fd23372b34f20c72c2442ddbd8"}
Jul 27 19:05:46.470920 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.470837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" event={"ID":"60fda6fc-1f8e-4132-83ab-43632e72b4ea","Type":"ContainerStarted","Data":"48f7c901bb734f28a57f0a8bc833192d8292ce73842a10bd11182f677d525bd0"}
Jul 27 19:05:46.471312 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.471288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:46.471427 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.471374    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:46.486889 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.486868    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:46.487001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.486994    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:46.511975 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:46.511905    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv" podStartSLOduration=9.236346794 podStartE2EDuration="28.511893315s" totalImagesPullingTime="19.275546521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:46.511257804 +0000 UTC m=+28.707226891" watchObservedRunningTime="2026-07-27 19:05:46.511893315 +0000 UTC m=+28.707862428"
Jul 27 19:05:47.473672 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.473645    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 19:05:47.765599 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.765561    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df7k9"]
Jul 27 19:05:47.765764 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.765694    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:47.765812 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:47.765793    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:47.766310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.766281    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5c8wf"]
Jul 27 19:05:47.766457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.766410    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:47.766547 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:47.766502    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:47.766925 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.766902    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lpxqb"]
Jul 27 19:05:47.767030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:47.766982    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:47.767077 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:47.767048    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:48.478188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:48.478008    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="42ea253dc43c2ee57d457a032de59a9715144f705275bd0dced1b0a71c462002" exitCode=0
Jul 27 19:05:48.478584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:48.478086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"42ea253dc43c2ee57d457a032de59a9715144f705275bd0dced1b0a71c462002"}
Jul 27 19:05:48.478584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:48.478390    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 27 19:05:48.822349 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:48.822320    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:05:49.243847 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:49.243815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:49.243847 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:49.243834    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:49.244078 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:49.243920    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:49.244078 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:49.243936    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:49.244078 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:49.243989    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:49.244258 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:49.244082    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:50.484720 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:50.484681    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="c08f39cdbad3ce851d5a18f099384d7acc84e3e483b71978394efef5920db891" exitCode=0
Jul 27 19:05:50.485431 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:50.484754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"c08f39cdbad3ce851d5a18f099384d7acc84e3e483b71978394efef5920db891"}
Jul 27 19:05:51.244123 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:51.244088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:51.244327 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:51.244088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:51.244327 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.244230    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5c8wf" podUID="33c330a1-7274-45b0-9753-cd623bc66ee7"
Jul 27 19:05:51.244327 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:51.244094    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:51.244327 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.244311    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-df7k9" podUID="cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1"
Jul 27 19:05:51.244533 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.244374    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lpxqb" podUID="32355029-5e93-45e5-b825-38d79fab2bf9"
Jul 27 19:05:51.972390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:51.972294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:51.972390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:51.972353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:51.972897 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.972474    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:51.972897 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.972474    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:51.972897 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.972582    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret podName:33c330a1-7274-45b0-9753-cd623bc66ee7 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:23.972561746 +0000 UTC m=+66.168530815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret") pod "global-pull-secret-syncer-5c8wf" (UID: "33c330a1-7274-45b0-9753-cd623bc66ee7") : object "kube-system"/"original-pull-secret" not registered
Jul 27 19:05:51.972897 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:51.972664    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs podName:cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:23.97264253 +0000 UTC m=+66.168611597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs") pod "network-metrics-daemon-df7k9" (UID: "cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 19:05:52.073360 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:52.073326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:52.073523 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:52.073467    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 19:05:52.073523 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:52.073483    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 19:05:52.073523 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:52.073493    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmt9q for pod openshift-network-diagnostics/network-check-target-lpxqb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:52.073664 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:52.073556    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q podName:32355029-5e93-45e5-b825-38d79fab2bf9 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:24.07353947 +0000 UTC m=+66.269508537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmt9q" (UniqueName: "kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q") pod "network-check-target-lpxqb" (UID: "32355029-5e93-45e5-b825-38d79fab2bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 19:05:53.100288 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.100264    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-61.ec2.internal" event="NodeReady"
Jul 27 19:05:53.100767 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.100432    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 19:05:53.135848 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.135818    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b5d69ff44-d2xn8"]
Jul 27 19:05:53.139466 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.139447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.141929 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.141904    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 19:05:53.142049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.141907    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vw56c\""
Jul 27 19:05:53.142187 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.142144    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 19:05:53.142283 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.142204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 19:05:53.152675 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.152648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b5d69ff44-d2xn8"]
Jul 27 19:05:53.155586 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.155563    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 19:05:53.156088 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.156063    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nbbkc"]
Jul 27 19:05:53.159264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.159244    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fb297"]
Jul 27 19:05:53.159396 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.159379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.161607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.161559    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z7dvk\""
Jul 27 19:05:53.161607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.161586    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 19:05:53.161724 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.161619    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 19:05:53.161865 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.161848    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 19:05:53.162530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.162503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.164163 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.164146    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 19:05:53.164345 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.164312    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:05:53.164446 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.164432    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 19:05:53.166014 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.165995    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbbkc"]
Jul 27 19:05:53.169101 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.169080    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fb297"]
Jul 27 19:05:53.243841 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.243810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:05:53.243998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.243814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:05:53.243998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.243947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:05:53.246108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246086    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:05:53.246268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246140    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:05:53.246268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246226    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:05:53.246268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246236    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:05:53.246567 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246545    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:05:53.246657 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.246577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:05:53.282910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.282890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.282910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.282919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.282945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.282967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.282992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbpmz\" (UniqueName: \"kubernetes.io/projected/aace3cc5-3286-4d8f-98e9-7f6256e57858-kube-api-access-jbpmz\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-cert\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.283093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aace3cc5-3286-4d8f-98e9-7f6256e57858-config-volume\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aace3cc5-3286-4d8f-98e9-7f6256e57858-tmp-dir\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7fr\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.283404 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.283321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvq7\" (UniqueName: \"kubernetes.io/projected/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-kube-api-access-8dvq7\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.384444 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.384444 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.384444 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.384444 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384447    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbpmz\" (UniqueName: \"kubernetes.io/projected/aace3cc5-3286-4d8f-98e9-7f6256e57858-kube-api-access-jbpmz\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.384518    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-cert\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.384535    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:05:53.384679 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.384603    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:53.884583195 +0000 UTC m=+36.080552276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:05:53.384882 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.384766    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:53.384882 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.384819    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:53.884794928 +0000 UTC m=+36.080763998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:53.384957 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aace3cc5-3286-4d8f-98e9-7f6256e57858-config-volume\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.385002 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.384983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385039 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385074 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aace3cc5-3286-4d8f-98e9-7f6256e57858-tmp-dir\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.385109 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7fr\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385143 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385197 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvq7\" (UniqueName: \"kubernetes.io/projected/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-kube-api-access-8dvq7\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.385674 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aace3cc5-3286-4d8f-98e9-7f6256e57858-tmp-dir\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.385674 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aace3cc5-3286-4d8f-98e9-7f6256e57858-config-volume\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.385674 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385916 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385749    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.385916 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.385775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.389342 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.389297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.389342 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.389324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.389499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.389436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-cert\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.393155 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.393129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.393393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.393374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbpmz\" (UniqueName: \"kubernetes.io/projected/aace3cc5-3286-4d8f-98e9-7f6256e57858-kube-api-access-jbpmz\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.393773 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.393756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7fr\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.393891 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.393864    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvq7\" (UniqueName: \"kubernetes.io/projected/6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff-kube-api-access-8dvq7\") pod \"ingress-canary-nbbkc\" (UID: \"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff\") " pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.470825 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.470788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nbbkc"
Jul 27 19:05:53.888217 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.888161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:53.888401 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:53.888288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:53.888401 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.888336    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:53.888401 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.888393    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:53.888401 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.888401    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:54.888385664 +0000 UTC m=+37.084354730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:53.888573 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.888408    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:05:53.888573 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:53.888454    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:54.88843932 +0000 UTC m=+37.084408406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:05:54.501944 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:54.501774    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nbbkc"]
Jul 27 19:05:54.505842 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:05:54.505810    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4a0890_24e4_4ffb_9e1d_0cccf1aa29ff.slice/crio-07580ee601969dda10852709f5b098547cb4e9703371af78e1e27ba6f9ef47a7 WatchSource:0}: Error finding container 07580ee601969dda10852709f5b098547cb4e9703371af78e1e27ba6f9ef47a7: Status 404 returned error can't find the container with id 07580ee601969dda10852709f5b098547cb4e9703371af78e1e27ba6f9ef47a7
Jul 27 19:05:54.895775 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:54.895746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:54.895912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:54.895784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:54.895912 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:54.895890    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:54.895912 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:54.895894    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:54.895912 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:54.895909    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:05:54.896055 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:54.895945    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.895931241 +0000 UTC m=+39.091900310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:54.896055 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:54.895964    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:05:56.895951072 +0000 UTC m=+39.091920138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:05:55.499558 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:55.499521    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="7aa63167561d01319a2d932086ab02edfac74b0db9dfe7b38d863b4d894f9f99" exitCode=0
Jul 27 19:05:55.499739 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:55.499619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"7aa63167561d01319a2d932086ab02edfac74b0db9dfe7b38d863b4d894f9f99"}
Jul 27 19:05:55.501217 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:55.500887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbbkc" event={"ID":"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff","Type":"ContainerStarted","Data":"07580ee601969dda10852709f5b098547cb4e9703371af78e1e27ba6f9ef47a7"}
Jul 27 19:05:56.507610 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:56.507576    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa929aef-a9d7-44c4-8760-9544afcc6468" containerID="49fefe4283eb409629347efa4653ffaae2a2b71a29b9b8ece42877aee5983fc2" exitCode=0
Jul 27 19:05:56.508055 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:56.507654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerDied","Data":"49fefe4283eb409629347efa4653ffaae2a2b71a29b9b8ece42877aee5983fc2"}
Jul 27 19:05:56.911546 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:56.911381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:05:56.911668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:56.911561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:05:56.911668 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:56.911522    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:05:56.911668 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:56.911625    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:05:56.911668 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:56.911666    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:05:56.911796 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:56.911679    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.91166389 +0000 UTC m=+43.107632955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:05:56.911796 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:56.911702    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.911692399 +0000 UTC m=+43.107661465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:05:57.511629 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:57.511599    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nbbkc" event={"ID":"6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff","Type":"ContainerStarted","Data":"1581b7ff46a3d554f3a12c7e76a720f3e1531ae26e2476bb72f335858fbe9434"}
Jul 27 19:05:57.514842 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:57.514816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-75z5h" event={"ID":"aa929aef-a9d7-44c4-8760-9544afcc6468","Type":"ContainerStarted","Data":"ce8d66e3b31b1b45394c6991825f930ac24111c22a3a9dfc5466146139c73896"}
Jul 27 19:05:57.527076 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:57.527035    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nbbkc" podStartSLOduration=2.09329873 podStartE2EDuration="4.52701914s" totalImagesPullingTime="2.43372041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:57.526501399 +0000 UTC m=+39.722470487" watchObservedRunningTime="2026-07-27 19:05:57.52701914 +0000 UTC m=+39.722988227"
Jul 27 19:05:57.546983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:57.546809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-75z5h" podStartSLOduration=8.927978367 podStartE2EDuration="39.546793917s" totalImagesPullingTime="30.61881555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:05:57.545778775 +0000 UTC m=+39.741747886" watchObservedRunningTime="2026-07-27 19:05:57.546793917 +0000 UTC m=+39.742763006"
Jul 27 19:05:59.289692 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.289659    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-46lcw"]
Jul 27 19:05:59.325827 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.325794    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-46lcw"]
Jul 27 19:05:59.325962 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.325905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.328197 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.328176    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 19:05:59.328377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.328356    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v7pgv\""
Jul 27 19:05:59.328480 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.328206    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 19:05:59.328480 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.328299    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 19:05:59.329021 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.329003    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 19:05:59.428188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.428146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a932cf25-2c36-4617-8d38-1bf360feab23-data-volume\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.428344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.428198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.428344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.428225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a932cf25-2c36-4617-8d38-1bf360feab23-crio-socket\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.428344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.428247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snzkg\" (UniqueName: \"kubernetes.io/projected/a932cf25-2c36-4617-8d38-1bf360feab23-kube-api-access-snzkg\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.428344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.428275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a932cf25-2c36-4617-8d38-1bf360feab23-data-volume\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a932cf25-2c36-4617-8d38-1bf360feab23-crio-socket\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snzkg\" (UniqueName: \"kubernetes.io/projected/a932cf25-2c36-4617-8d38-1bf360feab23-kube-api-access-snzkg\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528740 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:59.528666    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.528740 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:59.528718    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.028703254 +0000 UTC m=+42.224672320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:05:59.528740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528736    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528743    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a932cf25-2c36-4617-8d38-1bf360feab23-crio-socket\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.528994 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:59.528797    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.528994 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:05:59.528875    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:00.028858779 +0000 UTC m=+42.224827865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : configmap "kube-rbac-proxy" not found
Jul 27 19:05:59.528994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.528924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a932cf25-2c36-4617-8d38-1bf360feab23-data-volume\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:05:59.549203 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:05:59.549124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snzkg\" (UniqueName: \"kubernetes.io/projected/a932cf25-2c36-4617-8d38-1bf360feab23-kube-api-access-snzkg\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:00.031669 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:00.031635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:00.031860 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:00.031751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:00.031860 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.031790    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:00.031860 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.031853    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.032015 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.031869    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:01.031846117 +0000 UTC m=+43.227815182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:00.032015 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.031892    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:01.031880172 +0000 UTC m=+43.227849238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:00.938704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:00.938665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:06:00.938704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:00.938709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:00.939087 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.938812    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:06:00.939087 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.938830    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:06:00.939087 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.938855    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:06:00.939087 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.938884    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:08.938869529 +0000 UTC m=+51.134838594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:06:00.939087 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:00.938901    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:08.938890647 +0000 UTC m=+51.134859712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:06:01.039407 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:01.039370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:01.039561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:01.039423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:01.039561 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:01.039490    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:01.039561 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:01.039508    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:01.039561 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:01.039561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:03.039545058 +0000 UTC m=+45.235514132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:01.039707 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:01.039578    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:03.039569929 +0000 UTC m=+45.235538995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:01.277189 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:01.277145    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lq65n_c534fe2f-60b6-4a0a-bd85-520e1e6ed07f/dns-node-resolver/0.log"
Jul 27 19:06:02.477276 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:02.477249    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xzcw7_9f4a232b-038d-4339-b4c6-47d834944aab/node-ca/0.log"
Jul 27 19:06:03.054376 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:03.054342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:03.054548 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:03.054465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:03.054548 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:03.054469    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 19:06:03.054633 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:03.054561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:07.054542346 +0000 UTC m=+49.250511413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : configmap "kube-rbac-proxy" not found
Jul 27 19:06:03.054633 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:03.054564    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:03.054633 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:03.054601    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:07.054591711 +0000 UTC m=+49.250560776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:03.277112 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:03.277058    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbbkc_6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff/serve-healthcheck-canary/0.log"
Jul 27 19:06:07.086449 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:07.086413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:07.086907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:07.086469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:07.086907 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:07.086600    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.086907 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:07.086673    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls podName:a932cf25-2c36-4617-8d38-1bf360feab23 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:15.086654958 +0000 UTC m=+57.282624024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls") pod "insights-runtime-extractor-46lcw" (UID: "a932cf25-2c36-4617-8d38-1bf360feab23") : secret "insights-runtime-extractor-tls" not found
Jul 27 19:06:07.087040 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:07.087023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a932cf25-2c36-4617-8d38-1bf360feab23-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:09.002544 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:09.002515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") pod \"image-registry-7b5d69ff44-d2xn8\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") " pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:09.002553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:09.002687    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:09.002692    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:09.002712    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b5d69ff44-d2xn8: secret "image-registry-tls" not found
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:09.002742    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls podName:aace3cc5-3286-4d8f-98e9-7f6256e57858 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:25.002724023 +0000 UTC m=+67.198693090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls") pod "dns-default-fb297" (UID: "aace3cc5-3286-4d8f-98e9-7f6256e57858") : secret "dns-default-metrics-tls" not found
Jul 27 19:06:09.002978 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:09.002776    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls podName:b068d817-c772-492a-bede-618e558b2018 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:25.002758377 +0000 UTC m=+67.198727450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls") pod "image-registry-7b5d69ff44-d2xn8" (UID: "b068d817-c772-492a-bede-618e558b2018") : secret "image-registry-tls" not found
Jul 27 19:06:15.149519 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:15.149473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:15.151833 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:15.151812    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a932cf25-2c36-4617-8d38-1bf360feab23-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-46lcw\" (UID: \"a932cf25-2c36-4617-8d38-1bf360feab23\") " pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:15.235544 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:15.235520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-46lcw"
Jul 27 19:06:15.360348 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:15.360312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-46lcw"]
Jul 27 19:06:15.363853 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:15.363828    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda932cf25_2c36_4617_8d38_1bf360feab23.slice/crio-cee3fee041976d3d86901975b50b1cbc81b2dd36ac73142068c34781ede6ac75 WatchSource:0}: Error finding container cee3fee041976d3d86901975b50b1cbc81b2dd36ac73142068c34781ede6ac75: Status 404 returned error can't find the container with id cee3fee041976d3d86901975b50b1cbc81b2dd36ac73142068c34781ede6ac75
Jul 27 19:06:15.555521 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:15.555488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46lcw" event={"ID":"a932cf25-2c36-4617-8d38-1bf360feab23","Type":"ContainerStarted","Data":"cee3fee041976d3d86901975b50b1cbc81b2dd36ac73142068c34781ede6ac75"}
Jul 27 19:06:19.498436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:19.498405    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4tspv"
Jul 27 19:06:20.794374 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.794345    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"]
Jul 27 19:06:20.797335 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.797318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.800113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.800091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 19:06:20.800829 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.800812    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 19:06:20.800948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.800887    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 19:06:20.807028 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.807011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 19:06:20.809658 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.809630    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5d69ff44-d2xn8"]
Jul 27 19:06:20.810090 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:20.810066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8" podUID="b068d817-c772-492a-bede-618e558b2018"
Jul 27 19:06:20.823369 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.823347    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"]
Jul 27 19:06:20.896722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.896699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df844a83-a1f1-48db-bab8-99c99704708b-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.896824 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.896729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9bs\" (UniqueName: \"kubernetes.io/projected/df844a83-a1f1-48db-bab8-99c99704708b-kube-api-access-2v9bs\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.896824 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.896808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df844a83-a1f1-48db-bab8-99c99704708b-tmp\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.898207 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.898184    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bc7c676d4-grxp4"]
Jul 27 19:06:20.910995 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.910521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.989501 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.989469    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc7c676d4-grxp4"]
Jul 27 19:06:20.997412 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9bs\" (UniqueName: \"kubernetes.io/projected/df844a83-a1f1-48db-bab8-99c99704708b-kube-api-access-2v9bs\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.997541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-certificates\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-ca-trust-extracted\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df844a83-a1f1-48db-bab8-99c99704708b-tmp\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.997541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-installation-pull-secrets\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-trusted-ca\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-tls\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df844a83-a1f1-48db-bab8-99c99704708b-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.997738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-bound-sa-token\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df844a83-a1f1-48db-bab8-99c99704708b-tmp\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:20.997912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-image-registry-private-configuration\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:20.997998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:20.997913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmbdk\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-kube-api-access-cmbdk\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.000187 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.000146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/df844a83-a1f1-48db-bab8-99c99704708b-klusterlet-config\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:21.005969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.005948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9bs\" (UniqueName: \"kubernetes.io/projected/df844a83-a1f1-48db-bab8-99c99704708b-kube-api-access-2v9bs\") pod \"klusterlet-addon-workmgr-dd77f6c5d-xcf6c\" (UID: \"df844a83-a1f1-48db-bab8-99c99704708b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:21.098879 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.098789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-ca-trust-extracted\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.098879 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.098829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-installation-pull-secrets\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.098879 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.098848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-trusted-ca\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099085 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.098984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-tls\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099085 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.099040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-bound-sa-token\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099160 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.099121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-image-registry-private-configuration\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099218 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.099201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmbdk\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-kube-api-access-cmbdk\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099345 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.099324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-certificates\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.099474 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.099318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-ca-trust-extracted\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.100452 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.100430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-trusted-ca\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.100564 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.100503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-certificates\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.101728 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.101698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-installation-pull-secrets\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.101833 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.101732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-registry-tls\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.101893 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.101855    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-image-registry-private-configuration\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.105738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.105720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:21.109400 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.109378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmbdk\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-kube-api-access-cmbdk\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.109584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.109563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd-bound-sa-token\") pod \"image-registry-5bc7c676d4-grxp4\" (UID: \"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd\") " pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.224880 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.224844    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vw56c\""
Jul 27 19:06:21.229936 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.229915    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"]
Jul 27 19:06:21.232834 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.232806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.232999 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:21.232977    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf844a83_a1f1_48db_bab8_99c99704708b.slice/crio-f2a43026c4f2abf70edc33f4f0ca06b6fdcdb6687a9885cc64bca6a2f5acb4e0 WatchSource:0}: Error finding container f2a43026c4f2abf70edc33f4f0ca06b6fdcdb6687a9885cc64bca6a2f5acb4e0: Status 404 returned error can't find the container with id f2a43026c4f2abf70edc33f4f0ca06b6fdcdb6687a9885cc64bca6a2f5acb4e0
Jul 27 19:06:21.354630 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.354486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bc7c676d4-grxp4"]
Jul 27 19:06:21.356896 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:21.356872    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e7c8a4_10bc_4672_bd7a_ddb0fbfc34fd.slice/crio-8c39f30ba6ed53b3aba61a56ddf042644e91b874640fefb8e5d54ad822288ea9 WatchSource:0}: Error finding container 8c39f30ba6ed53b3aba61a56ddf042644e91b874640fefb8e5d54ad822288ea9: Status 404 returned error can't find the container with id 8c39f30ba6ed53b3aba61a56ddf042644e91b874640fefb8e5d54ad822288ea9
Jul 27 19:06:21.576311 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.576278    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4" event={"ID":"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd","Type":"ContainerStarted","Data":"d936d7bd8fc55069ba0dd87eb6d557ac3ab72f4dd7a1b2bfceee22a596e3bcef"}
Jul 27 19:06:21.576494 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.576335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4" event={"ID":"85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd","Type":"ContainerStarted","Data":"8c39f30ba6ed53b3aba61a56ddf042644e91b874640fefb8e5d54ad822288ea9"}
Jul 27 19:06:21.576494 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.576387    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:21.578953 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.578913    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46lcw" event={"ID":"a932cf25-2c36-4617-8d38-1bf360feab23","Type":"ContainerStarted","Data":"d7caef4c8da2c28ca11f6991cf5d06ecb10993aabc165a5b1308fedf5946e27b"}
Jul 27 19:06:21.581149 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.581101    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:06:21.581149 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.581133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c" event={"ID":"df844a83-a1f1-48db-bab8-99c99704708b","Type":"ContainerStarted","Data":"f2a43026c4f2abf70edc33f4f0ca06b6fdcdb6687a9885cc64bca6a2f5acb4e0"}
Jul 27 19:06:21.588632 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.588568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:06:21.615133 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.615055    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4" podStartSLOduration=1.615039496 podStartE2EDuration="1.615039496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:21.594899659 +0000 UTC m=+63.790868747" watchObservedRunningTime="2026-07-27 19:06:21.615039496 +0000 UTC m=+63.811008581"
Jul 27 19:06:21.705628 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705799 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705643    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705799 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705799 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705779    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705808    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.705969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.705879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs7fr\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr\") pod \"b068d817-c772-492a-bede-618e558b2018\" (UID: \"b068d817-c772-492a-bede-618e558b2018\") "
Jul 27 19:06:21.706081 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.706052    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:06:21.706254 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.706155    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-trusted-ca\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.706349 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.706327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:06:21.706561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.706540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:06:21.709202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.709117    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:06:21.709202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.709118    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:06:21.709622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.709594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr" (OuterVolumeSpecName: "kube-api-access-fs7fr") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "kube-api-access-fs7fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:06:21.711182 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.711128    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b068d817-c772-492a-bede-618e558b2018" (UID: "b068d817-c772-492a-bede-618e558b2018"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:06:21.807357 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807312    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-bound-sa-token\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.807357 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807350    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-installation-pull-secrets\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.807912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807368    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b068d817-c772-492a-bede-618e558b2018-ca-trust-extracted\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.807912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807382    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b068d817-c772-492a-bede-618e558b2018-registry-certificates\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.807912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807397    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs7fr\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-kube-api-access-fs7fr\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:21.807912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:21.807411    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b068d817-c772-492a-bede-618e558b2018-image-registry-private-configuration\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:22.585157 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:22.585078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b5d69ff44-d2xn8"
Jul 27 19:06:22.621302 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:22.621260    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b5d69ff44-d2xn8"]
Jul 27 19:06:22.622432 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:22.622403    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b5d69ff44-d2xn8"]
Jul 27 19:06:22.715632 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:22.715576    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b068d817-c772-492a-bede-618e558b2018-registry-tls\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:06:24.028423 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.028394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:06:24.028423 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.028427    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:06:24.031145 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.031122    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 19:06:24.031291 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.031144    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 19:06:24.041504 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.041485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1-metrics-certs\") pod \"network-metrics-daemon-df7k9\" (UID: \"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1\") " pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:06:24.041681 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.041619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33c330a1-7274-45b0-9753-cd623bc66ee7-original-pull-secret\") pod \"global-pull-secret-syncer-5c8wf\" (UID: \"33c330a1-7274-45b0-9753-cd623bc66ee7\") " pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:06:24.128989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.128953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:06:24.131770 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.131746    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 19:06:24.142129 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.142110    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 19:06:24.152727 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.152704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmt9q\" (UniqueName: \"kubernetes.io/projected/32355029-5e93-45e5-b825-38d79fab2bf9-kube-api-access-kmt9q\") pod \"network-check-target-lpxqb\" (UID: \"32355029-5e93-45e5-b825-38d79fab2bf9\") " pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:06:24.156363 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.156342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pxl4\""
Jul 27 19:06:24.161132 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.161113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5c8wf"
Jul 27 19:06:24.165278 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.165232    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:06:24.169245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.169227    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2xl5\""
Jul 27 19:06:24.177101 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.177083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-df7k9"
Jul 27 19:06:24.248773 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:24.248736    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b068d817-c772-492a-bede-618e558b2018" path="/var/lib/kubelet/pods/b068d817-c772-492a-bede-618e558b2018/volumes"
Jul 27 19:06:25.036099 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:25.036064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:25.038679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:25.038651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aace3cc5-3286-4d8f-98e9-7f6256e57858-metrics-tls\") pod \"dns-default-fb297\" (UID: \"aace3cc5-3286-4d8f-98e9-7f6256e57858\") " pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:25.279499 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:25.279467    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8j5l9\""
Jul 27 19:06:25.287360 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:25.287301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:27.410838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.410808    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fb297"]
Jul 27 19:06:27.597595 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:27.597523    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaace3cc5_3286_4d8f_98e9_7f6256e57858.slice/crio-f68ed2de16cfdbbbfc386003a574cc864a2103638f15bc1fb3a374336889750a WatchSource:0}: Error finding container f68ed2de16cfdbbbfc386003a574cc864a2103638f15bc1fb3a374336889750a: Status 404 returned error can't find the container with id f68ed2de16cfdbbbfc386003a574cc864a2103638f15bc1fb3a374336889750a
Jul 27 19:06:27.598864 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.598841    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c" event={"ID":"df844a83-a1f1-48db-bab8-99c99704708b","Type":"ContainerStarted","Data":"f3c42c60b3ad20155e6f75695a16cfb506005210b26b5b00146526bffe553ba0"}
Jul 27 19:06:27.599144 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.599051    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:27.600626 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.600608    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c"
Jul 27 19:06:27.613836 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.613792    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dd77f6c5d-xcf6c" podStartSLOduration=1.575712385 podStartE2EDuration="7.613778811s" totalImagesPullingTime="6.038066426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:27.613493258 +0000 UTC m=+69.809462347" watchObservedRunningTime="2026-07-27 19:06:27.613778811 +0000 UTC m=+69.809747893"
Jul 27 19:06:27.633722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.633700    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-df7k9"]
Jul 27 19:06:27.637779 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:27.637746    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcceaa3fe_f6c8_4580_b8cf_3472ab9b2aa1.slice/crio-0c907b27870422fe0e83653a981ad637d207571fe1b79286e7d39e092858d516 WatchSource:0}: Error finding container 0c907b27870422fe0e83653a981ad637d207571fe1b79286e7d39e092858d516: Status 404 returned error can't find the container with id 0c907b27870422fe0e83653a981ad637d207571fe1b79286e7d39e092858d516
Jul 27 19:06:27.639303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.639231    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5c8wf"]
Jul 27 19:06:27.640033 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:27.639893    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lpxqb"]
Jul 27 19:06:27.642416 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:27.642394    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c330a1_7274_45b0_9753_cd623bc66ee7.slice/crio-1e0d9918734ffc94e5aacaf0fd989df6956aa492c3695695476d01a0c1debccc WatchSource:0}: Error finding container 1e0d9918734ffc94e5aacaf0fd989df6956aa492c3695695476d01a0c1debccc: Status 404 returned error can't find the container with id 1e0d9918734ffc94e5aacaf0fd989df6956aa492c3695695476d01a0c1debccc
Jul 27 19:06:27.642970 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:27.642945    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32355029_5e93_45e5_b825_38d79fab2bf9.slice/crio-fd00b2ca7677306cdf8c52122b210f8ef31ee4a0a7d7f91237e0d08a049339e6 WatchSource:0}: Error finding container fd00b2ca7677306cdf8c52122b210f8ef31ee4a0a7d7f91237e0d08a049339e6: Status 404 returned error can't find the container with id fd00b2ca7677306cdf8c52122b210f8ef31ee4a0a7d7f91237e0d08a049339e6
Jul 27 19:06:28.604992 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:28.604893    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46lcw" event={"ID":"a932cf25-2c36-4617-8d38-1bf360feab23","Type":"ContainerStarted","Data":"953ec38c5e68eb6f86cf2c1cbbf9b6b675617d0e38ee3cc36adf78326fc77da2"}
Jul 27 19:06:28.607438 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:28.607407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lpxqb" event={"ID":"32355029-5e93-45e5-b825-38d79fab2bf9","Type":"ContainerStarted","Data":"fd00b2ca7677306cdf8c52122b210f8ef31ee4a0a7d7f91237e0d08a049339e6"}
Jul 27 19:06:28.608742 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:28.608710    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df7k9" event={"ID":"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1","Type":"ContainerStarted","Data":"0c907b27870422fe0e83653a981ad637d207571fe1b79286e7d39e092858d516"}
Jul 27 19:06:28.610088 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:28.610062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5c8wf" event={"ID":"33c330a1-7274-45b0-9753-cd623bc66ee7","Type":"ContainerStarted","Data":"1e0d9918734ffc94e5aacaf0fd989df6956aa492c3695695476d01a0c1debccc"}
Jul 27 19:06:28.611848 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:28.611823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb297" event={"ID":"aace3cc5-3286-4d8f-98e9-7f6256e57858","Type":"ContainerStarted","Data":"f68ed2de16cfdbbbfc386003a574cc864a2103638f15bc1fb3a374336889750a"}
Jul 27 19:06:29.621122 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:29.621083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df7k9" event={"ID":"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1","Type":"ContainerStarted","Data":"09b96645054ed355df08615c5012ef5a92465bc5a69437f9609436135d60799e"}
Jul 27 19:06:29.621588 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:29.621151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-df7k9" event={"ID":"cceaa3fe-f6c8-4580-b8cf-3472ab9b2aa1","Type":"ContainerStarted","Data":"3e6e62a5a40d21d1159630d26a1d88e62706aeae2f00fd3e27d1f9c923fec455"}
Jul 27 19:06:29.638284 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:29.637941    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-df7k9" podStartSLOduration=70.325664751 podStartE2EDuration="1m11.637922069s" totalImagesPullingTime="1.312257318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:29.635792757 +0000 UTC m=+71.831761846" watchObservedRunningTime="2026-07-27 19:06:29.637922069 +0000 UTC m=+71.833891159"
Jul 27 19:06:30.018676 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.018641    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"]
Jul 27 19:06:30.022999 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.022967    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:30.026683 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.026318    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9sxwp\""
Jul 27 19:06:30.026683 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.026543    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 27 19:06:30.035441 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.035384    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"]
Jul 27 19:06:30.073789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.073750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bpz6p\" (UID: \"5c2276f4-a086-4d48-8eb7-d74d30842e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:30.174744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.174690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bpz6p\" (UID: \"5c2276f4-a086-4d48-8eb7-d74d30842e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:30.174913 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:30.174850    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:06:30.174959 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:30.174921    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates podName:5c2276f4-a086-4d48-8eb7-d74d30842e34 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:30.674897477 +0000 UTC m=+72.870866546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" (UID: "5c2276f4-a086-4d48-8eb7-d74d30842e34") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:06:30.629280 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.629241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb297" event={"ID":"aace3cc5-3286-4d8f-98e9-7f6256e57858","Type":"ContainerStarted","Data":"1e43c47ac156e4ab4bf07705958646070c32a0a17c2cb85f12fe2f0f91727180"}
Jul 27 19:06:30.629857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.629325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fb297" event={"ID":"aace3cc5-3286-4d8f-98e9-7f6256e57858","Type":"ContainerStarted","Data":"3b20b1ffd14ad004127be5dd00d2380842359e7565cf35c8c75c8f17eeb7b99c"}
Jul 27 19:06:30.629857 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.629376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:30.646669 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.646623    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fb297" podStartSLOduration=34.971912677 podStartE2EDuration="37.646609046s" totalImagesPullingTime="2.674696369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:30.645594186 +0000 UTC m=+72.841563275" watchObservedRunningTime="2026-07-27 19:06:30.646609046 +0000 UTC m=+72.842578134"
Jul 27 19:06:30.679832 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:30.679360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bpz6p\" (UID: \"5c2276f4-a086-4d48-8eb7-d74d30842e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:30.679832 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:30.679488    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:06:30.679832 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:30.679576    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates podName:5c2276f4-a086-4d48-8eb7-d74d30842e34 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:31.67955405 +0000 UTC m=+73.875523119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" (UID: "5c2276f4-a086-4d48-8eb7-d74d30842e34") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 27 19:06:31.687004 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.686972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bpz6p\" (UID: \"5c2276f4-a086-4d48-8eb7-d74d30842e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:31.689871 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.689842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c2276f4-a086-4d48-8eb7-d74d30842e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-bpz6p\" (UID: \"5c2276f4-a086-4d48-8eb7-d74d30842e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:31.752898 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.752858    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:06:31.769056 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.768354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.769410 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.769381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:06:31.772106 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.771403    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 19:06:31.772106 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.771435    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 19:06:31.772106 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.771502    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 19:06:31.772106 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.771744    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 19:06:31.773139 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.773120    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m8xt6\""
Jul 27 19:06:31.773390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.773374    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 19:06:31.773490 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.773466    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 19:06:31.773558 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.773374    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 19:06:31.835039 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.835016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:31.888936 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.888905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.889052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.888944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.889052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.888975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.889052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.889037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.889207 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.889066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.889207 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.889083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjjfq\" (UniqueName: \"kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990306 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990330    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjjfq\" (UniqueName: \"kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.990704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.990488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.991097 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.991064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.991229 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.991097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.991348 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.991329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.993146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.993122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.993755 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.993731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:31.998428 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:31.998404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjjfq\" (UniqueName: \"kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq\") pod \"console-f8549cd45-2l42j\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") " pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:32.081179 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:32.081141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:34.898463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:34.898431    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:06:34.905637 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:34.905605    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e31165_904f_44f5_8eb0_ec9f76d14d88.slice/crio-3a8d6c564042110663f04257ca09aa48fabb3c0d2a53a2a1f992cd73153cb8d4 WatchSource:0}: Error finding container 3a8d6c564042110663f04257ca09aa48fabb3c0d2a53a2a1f992cd73153cb8d4: Status 404 returned error can't find the container with id 3a8d6c564042110663f04257ca09aa48fabb3c0d2a53a2a1f992cd73153cb8d4
Jul 27 19:06:34.913279 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:34.913241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"]
Jul 27 19:06:34.917456 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:34.917431    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2276f4_a086_4d48_8eb7_d74d30842e34.slice/crio-24ef6d097e7253bbf486f45dc7c5af2612ccef271cb72e505d15a824b4d8ccf8 WatchSource:0}: Error finding container 24ef6d097e7253bbf486f45dc7c5af2612ccef271cb72e505d15a824b4d8ccf8: Status 404 returned error can't find the container with id 24ef6d097e7253bbf486f45dc7c5af2612ccef271cb72e505d15a824b4d8ccf8
Jul 27 19:06:35.649760 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.649712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-46lcw" event={"ID":"a932cf25-2c36-4617-8d38-1bf360feab23","Type":"ContainerStarted","Data":"f4e248a5707094e2efff9561c11201d8fc6a4a05d498373b2b584966a073cd9c"}
Jul 27 19:06:35.651240 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.651209    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lpxqb" event={"ID":"32355029-5e93-45e5-b825-38d79fab2bf9","Type":"ContainerStarted","Data":"f23ba3859a7dda1123f807bc02819e1ac90f0b8e3f764e463b889de8e4212583"}
Jul 27 19:06:35.651383 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.651259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:06:35.652463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.652439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" event={"ID":"5c2276f4-a086-4d48-8eb7-d74d30842e34","Type":"ContainerStarted","Data":"24ef6d097e7253bbf486f45dc7c5af2612ccef271cb72e505d15a824b4d8ccf8"}
Jul 27 19:06:35.654182 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.654141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5c8wf" event={"ID":"33c330a1-7274-45b0-9753-cd623bc66ee7","Type":"ContainerStarted","Data":"3faf075f8fc2255f695bb800f73b755d8c59a953640fb78874cfc0ae29b29566"}
Jul 27 19:06:35.655458 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.655438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8549cd45-2l42j" event={"ID":"b5e31165-904f-44f5-8eb0-ec9f76d14d88","Type":"ContainerStarted","Data":"3a8d6c564042110663f04257ca09aa48fabb3c0d2a53a2a1f992cd73153cb8d4"}
Jul 27 19:06:35.667832 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.667789    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-46lcw" podStartSLOduration=17.506484463 podStartE2EDuration="36.667776643s" totalImagesPullingTime="19.16129218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:35.666025797 +0000 UTC m=+77.861994885" watchObservedRunningTime="2026-07-27 19:06:35.667776643 +0000 UTC m=+77.863745731"
Jul 27 19:06:35.698858 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.698511    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lpxqb" podStartSLOduration=70.58651546 podStartE2EDuration="1m17.698494352s" totalImagesPullingTime="7.111978892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:35.697863785 +0000 UTC m=+77.893832873" watchObservedRunningTime="2026-07-27 19:06:35.698494352 +0000 UTC m=+77.894463442"
Jul 27 19:06:35.698858 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:35.698651    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5c8wf" podStartSLOduration=70.593511902 podStartE2EDuration="1m17.698643374s" totalImagesPullingTime="7.105131472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:35.681273438 +0000 UTC m=+77.877242524" watchObservedRunningTime="2026-07-27 19:06:35.698643374 +0000 UTC m=+77.894612445"
Jul 27 19:06:36.661953 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:36.661909    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" event={"ID":"5c2276f4-a086-4d48-8eb7-d74d30842e34","Type":"ContainerStarted","Data":"b662995aa53101d141c924b87032427450f3aecb8eb7d83429245c034839bc28"}
Jul 27 19:06:36.662436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:36.662413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:36.664221 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:36.664189    2558 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.12:8443/healthz\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body=
Jul 27 19:06:36.664340 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:36.664263    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" podUID="5c2276f4-a086-4d48-8eb7-d74d30842e34" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.133.0.12:8443/healthz\": dial tcp 10.133.0.12:8443: connect: connection refused"
Jul 27 19:06:36.677372 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:36.677247    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p" podStartSLOduration=5.020909473 podStartE2EDuration="6.677227537s" totalImagesPullingTime="1.656318064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:36.676414889 +0000 UTC m=+78.872383977" watchObservedRunningTime="2026-07-27 19:06:36.677227537 +0000 UTC m=+78.873196630"
Jul 27 19:06:37.671212 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:37.671184    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-bpz6p"
Jul 27 19:06:38.082281 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.082242    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"]
Jul 27 19:06:38.085370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.085344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.088357 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088334    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 19:06:38.088357 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088350    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 27 19:06:38.088538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088362    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 19:06:38.088538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088421    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sp94z\""
Jul 27 19:06:38.088998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088977    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 27 19:06:38.089086 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.088999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 19:06:38.093049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.093023    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"]
Jul 27 19:06:38.143938 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.143888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d439e40-7ac6-407c-b893-a0748247a967-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.144113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.143987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpqx\" (UniqueName: \"kubernetes.io/projected/7d439e40-7ac6-407c-b893-a0748247a967-kube-api-access-jrpqx\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.144113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.144033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.144113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.144077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.244779 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.244746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d439e40-7ac6-407c-b893-a0748247a967-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.244979 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.244804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpqx\" (UniqueName: \"kubernetes.io/projected/7d439e40-7ac6-407c-b893-a0748247a967-kube-api-access-jrpqx\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.244979 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.244835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.244979 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.244862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.244979 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:38.244973    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 27 19:06:38.245216 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:38.245031    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls podName:7d439e40-7ac6-407c-b893-a0748247a967 nodeName:}" failed. No retries permitted until 2026-07-27 19:06:38.745011542 +0000 UTC m=+80.940980610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-v5ktz" (UID: "7d439e40-7ac6-407c-b893-a0748247a967") : secret "prometheus-operator-tls" not found
Jul 27 19:06:38.245595 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.245568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d439e40-7ac6-407c-b893-a0748247a967-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.248036 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.248000    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.255672 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.255636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpqx\" (UniqueName: \"kubernetes.io/projected/7d439e40-7ac6-407c-b893-a0748247a967-kube-api-access-jrpqx\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.750062 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.750019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.752703 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.752681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d439e40-7ac6-407c-b893-a0748247a967-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v5ktz\" (UID: \"7d439e40-7ac6-407c-b893-a0748247a967\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:38.996887 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:38.996852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"
Jul 27 19:06:39.120278 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:39.120229    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v5ktz"]
Jul 27 19:06:39.122653 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:39.122633    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d439e40_7ac6_407c_b893_a0748247a967.slice/crio-42d1467cb17fee3e3c95babcda6870f4b5a4b1231526cc6b11935d1bff58fd40 WatchSource:0}: Error finding container 42d1467cb17fee3e3c95babcda6870f4b5a4b1231526cc6b11935d1bff58fd40: Status 404 returned error can't find the container with id 42d1467cb17fee3e3c95babcda6870f4b5a4b1231526cc6b11935d1bff58fd40
Jul 27 19:06:39.679047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:39.678974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8549cd45-2l42j" event={"ID":"b5e31165-904f-44f5-8eb0-ec9f76d14d88","Type":"ContainerStarted","Data":"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"}
Jul 27 19:06:39.680303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:39.680273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz" event={"ID":"7d439e40-7ac6-407c-b893-a0748247a967","Type":"ContainerStarted","Data":"42d1467cb17fee3e3c95babcda6870f4b5a4b1231526cc6b11935d1bff58fd40"}
Jul 27 19:06:39.696761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:39.696709    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f8549cd45-2l42j" podStartSLOduration=4.948764932 podStartE2EDuration="8.696690956s" totalImagesPullingTime="3.747926024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:39.69625037 +0000 UTC m=+81.892219459" watchObservedRunningTime="2026-07-27 19:06:39.696690956 +0000 UTC m=+81.892660043"
Jul 27 19:06:40.537004 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.536954    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:06:40.539938 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.539922    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.547583 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.547560    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 19:06:40.549272 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.549244    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:06:40.636223 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.636190    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fb297"
Jul 27 19:06:40.666294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666490 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666490 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666490 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk869\" (UniqueName: \"kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666490 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.666683 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.666490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.686589 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.686512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz" event={"ID":"7d439e40-7ac6-407c-b893-a0748247a967","Type":"ContainerStarted","Data":"5b06149d082d41c896c6179a9c70aad3f0eab432e08e6da3b03a79d147f3a4cd"}
Jul 27 19:06:40.686589 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.686569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz" event={"ID":"7d439e40-7ac6-407c-b893-a0748247a967","Type":"ContainerStarted","Data":"92b7482559f7c373040cc01476194511c973b181113cf8a6c28114ee1c6675cc"}
Jul 27 19:06:40.709461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.709277    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-v5ktz" podStartSLOduration=1.413148747 podStartE2EDuration="2.709256496s" totalImagesPullingTime="1.296107749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:40.707719975 +0000 UTC m=+82.903689064" watchObservedRunningTime="2026-07-27 19:06:40.709256496 +0000 UTC m=+82.905225585"
Jul 27 19:06:40.767702 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.767665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768295 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk869\" (UniqueName: \"kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768295 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768089    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768295 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768295 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768295 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768620 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768620 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.768835 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.768805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.769245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.769197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.769319 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.769249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.770867 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.770848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.771108 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.771090    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.777442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.777424    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk869\" (UniqueName: \"kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869\") pod \"console-cc47c64c-7xbvv\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") " pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.851308 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.851271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:40.976344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:40.976265    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:06:40.979025 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:40.978997    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccf040c_fe1d_43b7_b3b3_76956e6d1267.slice/crio-26436366494e9d215323dc5b532143ef0ca5aac2e7e46e16f939dbaeb3b6f38a WatchSource:0}: Error finding container 26436366494e9d215323dc5b532143ef0ca5aac2e7e46e16f939dbaeb3b6f38a: Status 404 returned error can't find the container with id 26436366494e9d215323dc5b532143ef0ca5aac2e7e46e16f939dbaeb3b6f38a
Jul 27 19:06:41.692396 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:41.692363    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc47c64c-7xbvv" event={"ID":"5ccf040c-fe1d-43b7-b3b3-76956e6d1267","Type":"ContainerStarted","Data":"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"}
Jul 27 19:06:41.692742 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:41.692411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc47c64c-7xbvv" event={"ID":"5ccf040c-fe1d-43b7-b3b3-76956e6d1267","Type":"ContainerStarted","Data":"26436366494e9d215323dc5b532143ef0ca5aac2e7e46e16f939dbaeb3b6f38a"}
Jul 27 19:06:41.710717 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:41.710658    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cc47c64c-7xbvv" podStartSLOduration=1.710644071 podStartE2EDuration="1.710644071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:41.709815382 +0000 UTC m=+83.905784471" watchObservedRunningTime="2026-07-27 19:06:41.710644071 +0000 UTC m=+83.906613158"
Jul 27 19:06:42.081855 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.081810    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:42.082056 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.081908    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:42.086772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.086751    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:42.427429 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.427359    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"]
Jul 27 19:06:42.430691 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.430674    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.433020 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.432988    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 27 19:06:42.433109 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.433053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ql566\""
Jul 27 19:06:42.433109 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.433053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 27 19:06:42.441754 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.441734    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"]
Jul 27 19:06:42.447035 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.447017    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"]
Jul 27 19:06:42.450014 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.449995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.450696 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.450677    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k2m2s"]
Jul 27 19:06:42.453007 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.452987    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 27 19:06:42.453099 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.453012    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4k72c\""
Jul 27 19:06:42.453099 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.453028    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 27 19:06:42.453099 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.453012    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 27 19:06:42.453720 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.453705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.456017 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.455983    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 19:06:42.456249 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.456230    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g68sl\""
Jul 27 19:06:42.456249 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.456247    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 19:06:42.456377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.456252    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 19:06:42.463920 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.463901    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"]
Jul 27 19:06:42.582419 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.582419 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-metrics-client-ca\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986ff011-2f2c-4b92-b980-d979f7b89c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-textfile\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62kn\" (UniqueName: \"kubernetes.io/projected/43518ac6-4231-48df-b745-a86990296b9f-kube-api-access-z62kn\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582670 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-sys\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-tls\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhn5l\" (UniqueName: \"kubernetes.io/projected/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-api-access-jhn5l\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkqgb\" (UniqueName: \"kubernetes.io/projected/986ff011-2f2c-4b92-b980-d979f7b89c5c-kube-api-access-kkqgb\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-wtmp\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-root\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.582952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8122233e-5b57-48af-875c-7d59ddfb82e1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.583220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.582970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.589196 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.589160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bc7c676d4-grxp4"
Jul 27 19:06:42.684297 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhn5l\" (UniqueName: \"kubernetes.io/projected/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-api-access-jhn5l\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.684297 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.684528 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.684528 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkqgb\" (UniqueName: \"kubernetes.io/projected/986ff011-2f2c-4b92-b980-d979f7b89c5c-kube-api-access-kkqgb\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.684528 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-wtmp\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.684528 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-root\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8122233e-5b57-48af-875c-7d59ddfb82e1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-root\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-wtmp\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.684733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-metrics-client-ca\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986ff011-2f2c-4b92-b980-d979f7b89c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-textfile\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684932    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8122233e-5b57-48af-875c-7d59ddfb82e1-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62kn\" (UniqueName: \"kubernetes.io/projected/43518ac6-4231-48df-b745-a86990296b9f-kube-api-access-z62kn\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685030 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.684987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-sys\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685553 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-tls\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685553 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.685646 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-metrics-client-ca\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685695 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986ff011-2f2c-4b92-b980-d979f7b89c5c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.685695 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8122233e-5b57-48af-875c-7d59ddfb82e1-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.685798 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-textfile\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.685798 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:42.685753    2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 27 19:06:42.685891 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:06:42.685822    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls podName:986ff011-2f2c-4b92-b980-d979f7b89c5c nodeName:}" failed. No retries permitted until 2026-07-27 19:06:43.185802898 +0000 UTC m=+85.381771965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-xc2sl" (UID: "986ff011-2f2c-4b92-b980-d979f7b89c5c") : secret "openshift-state-metrics-tls" not found
Jul 27 19:06:42.686004 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.685968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.686082 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.686003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43518ac6-4231-48df-b745-a86990296b9f-sys\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.687325 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.687299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.687810 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.687783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.687922 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.687905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.688049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.688032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43518ac6-4231-48df-b745-a86990296b9f-node-exporter-tls\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.688407 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.688390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.697319 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.697183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhn5l\" (UniqueName: \"kubernetes.io/projected/8122233e-5b57-48af-875c-7d59ddfb82e1-kube-api-access-jhn5l\") pod \"kube-state-metrics-56d9f944b4-9x4nv\" (UID: \"8122233e-5b57-48af-875c-7d59ddfb82e1\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.697902 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.697877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkqgb\" (UniqueName: \"kubernetes.io/projected/986ff011-2f2c-4b92-b980-d979f7b89c5c-kube-api-access-kkqgb\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:42.699153 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.698211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62kn\" (UniqueName: \"kubernetes.io/projected/43518ac6-4231-48df-b745-a86990296b9f-kube-api-access-z62kn\") pod \"node-exporter-k2m2s\" (UID: \"43518ac6-4231-48df-b745-a86990296b9f\") " pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.702756 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.702734    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:06:42.759593 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.759569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"
Jul 27 19:06:42.765722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.765706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k2m2s"
Jul 27 19:06:42.776431 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:42.776406    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43518ac6_4231_48df_b745_a86990296b9f.slice/crio-ab5925b244dfeaf2c30b8d5809a334fc4ea88e7a4d4de2177b76a3663dd9b2fc WatchSource:0}: Error finding container ab5925b244dfeaf2c30b8d5809a334fc4ea88e7a4d4de2177b76a3663dd9b2fc: Status 404 returned error can't find the container with id ab5925b244dfeaf2c30b8d5809a334fc4ea88e7a4d4de2177b76a3663dd9b2fc
Jul 27 19:06:42.888336 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:42.888310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv"]
Jul 27 19:06:42.891683 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:42.891660    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8122233e_5b57_48af_875c_7d59ddfb82e1.slice/crio-c5d5a7b1d4c67b3d66720d29c19bf7731085053a2a815988bd4ef71769e26f56 WatchSource:0}: Error finding container c5d5a7b1d4c67b3d66720d29c19bf7731085053a2a815988bd4ef71769e26f56: Status 404 returned error can't find the container with id c5d5a7b1d4c67b3d66720d29c19bf7731085053a2a815988bd4ef71769e26f56
Jul 27 19:06:43.188983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.188949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:43.191460 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.191433    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/986ff011-2f2c-4b92-b980-d979f7b89c5c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xc2sl\" (UID: \"986ff011-2f2c-4b92-b980-d979f7b89c5c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:43.339769 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.339739    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"
Jul 27 19:06:43.500734 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.500704    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl"]
Jul 27 19:06:43.505349 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:43.505316    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986ff011_2f2c_4b92_b980_d979f7b89c5c.slice/crio-5e8ce635c5ce576f8bb8e5b0592de13c0b73e0a33e95a3e405e79689423c5874 WatchSource:0}: Error finding container 5e8ce635c5ce576f8bb8e5b0592de13c0b73e0a33e95a3e405e79689423c5874: Status 404 returned error can't find the container with id 5e8ce635c5ce576f8bb8e5b0592de13c0b73e0a33e95a3e405e79689423c5874
Jul 27 19:06:43.702892 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.702811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv" event={"ID":"8122233e-5b57-48af-875c-7d59ddfb82e1","Type":"ContainerStarted","Data":"c5d5a7b1d4c67b3d66720d29c19bf7731085053a2a815988bd4ef71769e26f56"}
Jul 27 19:06:43.704958 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.704922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl" event={"ID":"986ff011-2f2c-4b92-b980-d979f7b89c5c","Type":"ContainerStarted","Data":"74e2cc65d7b723987840dfbf31263e5abadf20ec83ab00798069a045b56ca37a"}
Jul 27 19:06:43.705088 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.704984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl" event={"ID":"986ff011-2f2c-4b92-b980-d979f7b89c5c","Type":"ContainerStarted","Data":"5e8ce635c5ce576f8bb8e5b0592de13c0b73e0a33e95a3e405e79689423c5874"}
Jul 27 19:06:43.706512 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:43.706487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2m2s" event={"ID":"43518ac6-4231-48df-b745-a86990296b9f","Type":"ContainerStarted","Data":"ab5925b244dfeaf2c30b8d5809a334fc4ea88e7a4d4de2177b76a3663dd9b2fc"}
Jul 27 19:06:44.721439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:44.721238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl" event={"ID":"986ff011-2f2c-4b92-b980-d979f7b89c5c","Type":"ContainerStarted","Data":"463615a051c28f7576af84347f7a1d2981501f34a6a9c75766aab253e258dcea"}
Jul 27 19:06:44.724568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:44.723839    2558 generic.go:356] "Generic (PLEG): container finished" podID="43518ac6-4231-48df-b745-a86990296b9f" containerID="7fdf70b141895ee17a08d3a93dbb246da28364375dc7dc39dc62a9e07b2bcdc9" exitCode=0
Jul 27 19:06:44.724694 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:44.724577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2m2s" event={"ID":"43518ac6-4231-48df-b745-a86990296b9f","Type":"ContainerDied","Data":"7fdf70b141895ee17a08d3a93dbb246da28364375dc7dc39dc62a9e07b2bcdc9"}
Jul 27 19:06:44.727306 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:44.727260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv" event={"ID":"8122233e-5b57-48af-875c-7d59ddfb82e1","Type":"ContainerStarted","Data":"8a3fa1dea72f7ba29542f3cf6856ab46a8123c1b7b30d400b6fb7b035c4ed693"}
Jul 27 19:06:44.727410 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:44.727387    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv" event={"ID":"8122233e-5b57-48af-875c-7d59ddfb82e1","Type":"ContainerStarted","Data":"53f62358745f90801758d648060f0f08053447435fb470159a5f38348ebdcaab"}
Jul 27 19:06:45.736105 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.736072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl" event={"ID":"986ff011-2f2c-4b92-b980-d979f7b89c5c","Type":"ContainerStarted","Data":"3c258756aa9159d6c318162ebb99bf16b7becd04ad69a298f7262cbe683aacfa"}
Jul 27 19:06:45.738244 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.738214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2m2s" event={"ID":"43518ac6-4231-48df-b745-a86990296b9f","Type":"ContainerStarted","Data":"ec3f2dbf389d77baf60c8f4167e6bf520cdb4f93f0aa215297efab9ac9399e6d"}
Jul 27 19:06:45.738386 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.738270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k2m2s" event={"ID":"43518ac6-4231-48df-b745-a86990296b9f","Type":"ContainerStarted","Data":"3b82e0093a0763647f7bd52211a0d56670ea353fa728369ac1d66aeca4516b3f"}
Jul 27 19:06:45.740253 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.740211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv" event={"ID":"8122233e-5b57-48af-875c-7d59ddfb82e1","Type":"ContainerStarted","Data":"f7b731fade0e6e3ecfe0a1630654e5eaa656aabd2e7f1f5d7d447d4721cdb78d"}
Jul 27 19:06:45.752802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.752750    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xc2sl" podStartSLOduration=2.315431321 podStartE2EDuration="3.752731525s" totalImagesPullingTime="1.437300204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:45.752407004 +0000 UTC m=+87.948376093" watchObservedRunningTime="2026-07-27 19:06:45.752731525 +0000 UTC m=+87.948700614"
Jul 27 19:06:45.768888 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.768833    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9x4nv" podStartSLOduration=2.089597516 podStartE2EDuration="3.768822456s" totalImagesPullingTime="1.67922494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:45.768005224 +0000 UTC m=+87.963974321" watchObservedRunningTime="2026-07-27 19:06:45.768822456 +0000 UTC m=+87.964791537"
Jul 27 19:06:45.788662 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:45.788619    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k2m2s" podStartSLOduration=2.676398924 podStartE2EDuration="3.788605064s" totalImagesPullingTime="1.037974538s" totalInitContainerRuntime="74.231602ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:45.787686238 +0000 UTC m=+87.983655337" watchObservedRunningTime="2026-07-27 19:06:45.788605064 +0000 UTC m=+87.984574151"
Jul 27 19:06:46.787653 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.787617    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"]
Jul 27 19:06:46.791378 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.791358    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.795093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-llkvfm2oe2bk\""
Jul 27 19:06:46.795093 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 19:06:46.795298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 19:06:46.795298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795083    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gbkrz\""
Jul 27 19:06:46.795298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795108    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 19:06:46.795298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.795134    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 19:06:46.798935 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.798916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"]
Jul 27 19:06:46.921305 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-tls\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-client-certs\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-kube-api-access-7tpjm\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-metrics-server-audit-profiles\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921669 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-client-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921871 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-audit-log\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:46.921946 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:46.921902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023155 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-client-certs\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-kube-api-access-7tpjm\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-metrics-server-audit-profiles\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-client-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-audit-log\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023552 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-tls\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.023812 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.023781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-audit-log\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.024235 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.024209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.024326 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.024252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-metrics-server-audit-profiles\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.025745 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.025727    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-client-ca-bundle\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.025814 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.025765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-tls\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.025880 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.025825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-secret-metrics-server-client-certs\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.033402 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.033381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tpjm\" (UniqueName: \"kubernetes.io/projected/7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4-kube-api-access-7tpjm\") pod \"metrics-server-5f67cbfd8b-f6zwt\" (UID: \"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4\") " pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.101808 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.101754    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:06:47.237816 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.237782    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"]
Jul 27 19:06:47.241102 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:47.241075    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d45946b_6b5b_4b0b_a9ed_b6a4bcd38ce4.slice/crio-7a721704014d991114947c987c8ae39b3db4237441f297bbaffc9f798b0d6528 WatchSource:0}: Error finding container 7a721704014d991114947c987c8ae39b3db4237441f297bbaffc9f798b0d6528: Status 404 returned error can't find the container with id 7a721704014d991114947c987c8ae39b3db4237441f297bbaffc9f798b0d6528
Jul 27 19:06:47.554456 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.554422    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:06:47.590725 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.590701    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:06:47.595178 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.595149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.603394 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.603375    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:06:47.655419 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.655389    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"]
Jul 27 19:06:47.658699 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.658682    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.661130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 27 19:06:47.661237 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 27 19:06:47.661294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661241    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 27 19:06:47.661343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661294    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 27 19:06:47.661343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661125    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-prl2l\""
Jul 27 19:06:47.661455 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.661196    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 27 19:06:47.666978 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.666961    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 27 19:06:47.671099 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.671080    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"]
Jul 27 19:06:47.730606 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730755 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730755 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq5n6\" (UniqueName: \"kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730922 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.730998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.730962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.756432 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.755968    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt" event={"ID":"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4","Type":"ContainerStarted","Data":"7a721704014d991114947c987c8ae39b3db4237441f297bbaffc9f798b0d6528"}
Jul 27 19:06:47.831568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.831568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.831568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-serving-certs-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7w5d\" (UniqueName: \"kubernetes.io/projected/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-kube-api-access-s7w5d\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq5n6\" (UniqueName: \"kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.831840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832402 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-metrics-client-ca\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832402 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832402 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832402 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-federate-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.832628 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832727 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.832782 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.832755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.833060 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.833035    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.834204 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.834183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.834328 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.834314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.839080 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.839061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq5n6\" (UniqueName: \"kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6\") pod \"console-6b6d8cdb99-xddtt\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") " pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.905467 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.905207    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:47.933012 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.932983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933018    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7w5d\" (UniqueName: \"kubernetes.io/projected/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-kube-api-access-s7w5d\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-metrics-client-ca\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-federate-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933310 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-serving-certs-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.933920 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.933899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-serving-certs-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.934097 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.934074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-metrics-client-ca\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.935569 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.935540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.936038 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.935995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.936504 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.936481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-federate-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.938415 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.938389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-telemeter-client-tls\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.938643 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.938616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-secret-telemeter-client\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.941777 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.941752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7w5d\" (UniqueName: \"kubernetes.io/projected/70b2cef4-ea6a-46a9-a77a-7f78100b4f9c-kube-api-access-s7w5d\") pod \"telemeter-client-57b6bfc984-hcsmv\" (UID: \"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c\") " pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:47.969143 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:47.968929    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"
Jul 27 19:06:48.057478 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.057452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:06:48.060239 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:48.060210    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09021ebe_54df_4145_8ae9_9c7cc405f5fa.slice/crio-138b1693dacd8acffff1c604810604dbf97e193dff20891e592e1f942bdc3c6e WatchSource:0}: Error finding container 138b1693dacd8acffff1c604810604dbf97e193dff20891e592e1f942bdc3c6e: Status 404 returned error can't find the container with id 138b1693dacd8acffff1c604810604dbf97e193dff20891e592e1f942bdc3c6e
Jul 27 19:06:48.133046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.132963    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57b6bfc984-hcsmv"]
Jul 27 19:06:48.135643 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:48.135612    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b2cef4_ea6a_46a9_a77a_7f78100b4f9c.slice/crio-875f6f6aa77ac7426fcae5d90b84bf05255ddb13ff2ea41f845b1b44bcfcd02f WatchSource:0}: Error finding container 875f6f6aa77ac7426fcae5d90b84bf05255ddb13ff2ea41f845b1b44bcfcd02f: Status 404 returned error can't find the container with id 875f6f6aa77ac7426fcae5d90b84bf05255ddb13ff2ea41f845b1b44bcfcd02f
Jul 27 19:06:48.641046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.640980    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:06:48.645436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.645409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.649447 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649428    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 19:06:48.649560 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649512    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 19:06:48.649617 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649428    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 19:06:48.649731 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649711    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 19:06:48.649789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649777    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 19:06:48.649971 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.649956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 19:06:48.650367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.650347    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fh8rs\""
Jul 27 19:06:48.650560 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.650543    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 19:06:48.650629 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.650596    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 19:06:48.650904 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.650883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 19:06:48.651051 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.650914    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 19:06:48.651051 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.651043    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 19:06:48.651206 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.651191    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 19:06:48.651840 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.651335    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pdvc9qif6t07\""
Jul 27 19:06:48.651840 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.651404    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 19:06:48.652579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.652558    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 19:06:48.660835 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.660679    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:06:48.744210 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744210 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lbdp\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744625    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744901 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744901 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.744901 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744858    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.745052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.744901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.769283 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.769245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv" event={"ID":"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c","Type":"ContainerStarted","Data":"875f6f6aa77ac7426fcae5d90b84bf05255ddb13ff2ea41f845b1b44bcfcd02f"}
Jul 27 19:06:48.771162 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.771137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d8cdb99-xddtt" event={"ID":"09021ebe-54df-4145-8ae9-9c7cc405f5fa","Type":"ContainerStarted","Data":"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"}
Jul 27 19:06:48.771294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.771201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d8cdb99-xddtt" event={"ID":"09021ebe-54df-4145-8ae9-9c7cc405f5fa","Type":"ContainerStarted","Data":"138b1693dacd8acffff1c604810604dbf97e193dff20891e592e1f942bdc3c6e"}
Jul 27 19:06:48.787997 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.787943    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6d8cdb99-xddtt" podStartSLOduration=1.7879300580000002 podStartE2EDuration="1.787930058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:48.787731001 +0000 UTC m=+90.983700084" watchObservedRunningTime="2026-07-27 19:06:48.787930058 +0000 UTC m=+90.983899146"
Jul 27 19:06:48.845626 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.845626 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845827    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lbdp\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.845966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.846948 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.846614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.847199 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.847037    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.847570 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.847449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.847737 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.847712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.848406 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.848105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.849485 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.849451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.849883 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.849859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.850324 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.850297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.853703 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.852679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.853703 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.853248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.853703 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.853693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.854832 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.854543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.855671 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.855225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.855671 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.855497    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.855671 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.855636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.856079 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.856049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.856516 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.856499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lbdp\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.856580 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.856527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:48.961350 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:48.961323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:06:49.133722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:49.131368    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:06:49.136779 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:06:49.136750    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f4a2dd_a0bf_47e3_8aef_b7266ea0698e.slice/crio-aa0b0dbc6bba815062390a35c85562f01ae8566d4ade773cb88db8c99797c8fe WatchSource:0}: Error finding container aa0b0dbc6bba815062390a35c85562f01ae8566d4ade773cb88db8c99797c8fe: Status 404 returned error can't find the container with id aa0b0dbc6bba815062390a35c85562f01ae8566d4ade773cb88db8c99797c8fe
Jul 27 19:06:49.776186 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:49.776123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt" event={"ID":"7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4","Type":"ContainerStarted","Data":"7f43d52c86bc8cb95b468b437a2a575fb0291bca2dde70cb5b5e0f0efcc67421"}
Jul 27 19:06:49.777270 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:49.777246    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"aa0b0dbc6bba815062390a35c85562f01ae8566d4ade773cb88db8c99797c8fe"}
Jul 27 19:06:49.794560 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:49.794514    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt" podStartSLOduration=2.127068098 podStartE2EDuration="3.794499257s" totalImagesPullingTime="1.667431159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:49.793508761 +0000 UTC m=+91.989477852" watchObservedRunningTime="2026-07-27 19:06:49.794499257 +0000 UTC m=+91.990468323"
Jul 27 19:06:50.852201 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:50.852154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:06:51.793122 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.793027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv" event={"ID":"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c","Type":"ContainerStarted","Data":"10808bc06d795d971f67117bfa5f40b5cc0a50bc36fc574c180bc041dceffd5e"}
Jul 27 19:06:51.793122 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.793111    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv" event={"ID":"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c","Type":"ContainerStarted","Data":"5057a5d4927527b9f17fb4232dd35235b8ae1e1de97c2464fff4b92241ba1480"}
Jul 27 19:06:51.793356 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.793139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv" event={"ID":"70b2cef4-ea6a-46a9-a77a-7f78100b4f9c","Type":"ContainerStarted","Data":"9dc93849a8628ef28242ad6ef2770ff8109bce55826e309c48188558bdcc6706"}
Jul 27 19:06:51.794550 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.794525    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8" exitCode=0
Jul 27 19:06:51.794669 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.794554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"}
Jul 27 19:06:51.814761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:51.814710    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57b6bfc984-hcsmv" podStartSLOduration=1.682530495 podStartE2EDuration="4.81469096s" totalImagesPullingTime="3.132160465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:51.812772917 +0000 UTC m=+94.008742006" watchObservedRunningTime="2026-07-27 19:06:51.81469096 +0000 UTC m=+94.010660050"
Jul 27 19:06:52.485569 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:52.485536    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:06:55.819697 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:55.819656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"}
Jul 27 19:06:55.820213 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:55.819776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"}
Jul 27 19:06:57.831343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.831312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"}
Jul 27 19:06:57.831725 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.831374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"}
Jul 27 19:06:57.831725 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.831404    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"}
Jul 27 19:06:57.831725 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.831427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerStarted","Data":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"}
Jul 27 19:06:57.863758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.863700    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.887978712 podStartE2EDuration="9.863677597s" totalImagesPullingTime="6.953925382s" totalInitContainerRuntime="21.773503ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:06:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:06:57.861673985 +0000 UTC m=+100.057643075" watchObservedRunningTime="2026-07-27 19:06:57.863677597 +0000 UTC m=+100.059646685"
Jul 27 19:06:57.905421 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:57.905389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:06:58.961710 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:06:58.961680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:07:03.526380 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:03.526344    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:07:06.664866 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:06.664839    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lpxqb"
Jul 27 19:07:07.102512 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:07.102487    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:07:07.102686 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:07.102544    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:07:12.573920 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.573855    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cc47c64c-7xbvv" podUID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" containerName="console" containerID="cri-o://3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297" gracePeriod=15
Jul 27 19:07:12.822249 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.822225    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:07:12.893529 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.893451    2558 generic.go:356] "Generic (PLEG): container finished" podID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" containerID="3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297" exitCode=0
Jul 27 19:07:12.893529 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.893494    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc47c64c-7xbvv"
Jul 27 19:07:12.893758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.893545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc47c64c-7xbvv" event={"ID":"5ccf040c-fe1d-43b7-b3b3-76956e6d1267","Type":"ContainerDied","Data":"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"}
Jul 27 19:07:12.893758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.893599    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc47c64c-7xbvv" event={"ID":"5ccf040c-fe1d-43b7-b3b3-76956e6d1267","Type":"ContainerDied","Data":"26436366494e9d215323dc5b532143ef0ca5aac2e7e46e16f939dbaeb3b6f38a"}
Jul 27 19:07:12.893758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.893626    2558 scope.go:117] "RemoveContainer" containerID="3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"
Jul 27 19:07:12.901827 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.901811    2558 scope.go:117] "RemoveContainer" containerID="3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"
Jul 27 19:07:12.902105 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:07:12.902078    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297\": container with ID starting with 3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297 not found: ID does not exist" containerID="3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"
Jul 27 19:07:12.902183 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.902115    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297"} err="failed to get container status \"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297\": rpc error: code = NotFound desc = could not find container \"3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297\": container with ID starting with 3a532588b042aa074d84d5ce0faf72f3d2de2b7b771d2edd71509cd42f400297 not found: ID does not exist"
Jul 27 19:07:12.976714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976688    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.976714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976715    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.976856 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976753    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk869\" (UniqueName: \"kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.976856 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.976856 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.976856 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976819    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.977063 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.976878    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca\") pod \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\" (UID: \"5ccf040c-fe1d-43b7-b3b3-76956e6d1267\") "
Jul 27 19:07:12.977223 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.977150    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:12.977461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.977234    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config" (OuterVolumeSpecName: "console-config") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:12.977461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.977441    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:12.977461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.977458    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:12.979078 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.979058    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869" (OuterVolumeSpecName: "kube-api-access-tk869") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "kube-api-access-tk869". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:12.979506 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.979489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:12.979565 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:12.979519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ccf040c-fe1d-43b7-b3b3-76956e6d1267" (UID: "5ccf040c-fe1d-43b7-b3b3-76956e6d1267"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:13.078354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078316    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-service-ca\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078351    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-oauth-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078360    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-trusted-ca-bundle\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078369    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk869\" (UniqueName: \"kubernetes.io/projected/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-kube-api-access-tk869\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078377    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078387    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-console-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.078584 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.078395    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ccf040c-fe1d-43b7-b3b3-76956e6d1267-oauth-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:13.218518 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.218491    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:07:13.226141 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:13.226107    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc47c64c-7xbvv"]
Jul 27 19:07:14.249219 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:14.249187    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" path="/var/lib/kubelet/pods/5ccf040c-fe1d-43b7-b3b3-76956e6d1267/volumes"
Jul 27 19:07:17.504744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.504687    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b6d8cdb99-xddtt" podUID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" containerName="console" containerID="cri-o://6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7" gracePeriod=15
Jul 27 19:07:17.744240 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.744211    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:07:17.821454 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821377    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq5n6\" (UniqueName: \"kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821454 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821413    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821645 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821463    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821700 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821640    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821752 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821709    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821752 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821801    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config\") pod \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\" (UID: \"09021ebe-54df-4145-8ae9-9c7cc405f5fa\") "
Jul 27 19:07:17.821981 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821881    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:17.821981 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821936    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:17.822373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.821998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:17.822373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.822104    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config" (OuterVolumeSpecName: "console-config") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:17.822373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.822133    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-service-ca\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.822373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.822151    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-trusted-ca-bundle\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.822373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.822162    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-oauth-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.823822 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.823796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6" (OuterVolumeSpecName: "kube-api-access-nq5n6") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "kube-api-access-nq5n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:17.824101 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.824081    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:17.824196 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.824155    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09021ebe-54df-4145-8ae9-9c7cc405f5fa" (UID: "09021ebe-54df-4145-8ae9-9c7cc405f5fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:17.916328 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.916292    2558 generic.go:356] "Generic (PLEG): container finished" podID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" containerID="6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7" exitCode=0
Jul 27 19:07:17.916502 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.916348    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6d8cdb99-xddtt"
Jul 27 19:07:17.916502 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.916357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d8cdb99-xddtt" event={"ID":"09021ebe-54df-4145-8ae9-9c7cc405f5fa","Type":"ContainerDied","Data":"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"}
Jul 27 19:07:17.916502 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.916420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6d8cdb99-xddtt" event={"ID":"09021ebe-54df-4145-8ae9-9c7cc405f5fa","Type":"ContainerDied","Data":"138b1693dacd8acffff1c604810604dbf97e193dff20891e592e1f942bdc3c6e"}
Jul 27 19:07:17.916502 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.916447    2558 scope.go:117] "RemoveContainer" containerID="6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"
Jul 27 19:07:17.922701 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.922682    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq5n6\" (UniqueName: \"kubernetes.io/projected/09021ebe-54df-4145-8ae9-9c7cc405f5fa-kube-api-access-nq5n6\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.922701 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.922701    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.922839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.922710    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.922839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.922720    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09021ebe-54df-4145-8ae9-9c7cc405f5fa-console-oauth-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:17.925761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.925746    2558 scope.go:117] "RemoveContainer" containerID="6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"
Jul 27 19:07:17.926029 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:07:17.926005    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7\": container with ID starting with 6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7 not found: ID does not exist" containerID="6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"
Jul 27 19:07:17.926115 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.926039    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7"} err="failed to get container status \"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7\": rpc error: code = NotFound desc = could not find container \"6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7\": container with ID starting with 6a9eed429514055d83637e835759e19e9a31faa5ef88335541d71c98d4ba71e7 not found: ID does not exist"
Jul 27 19:07:17.938543 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.938517    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:07:17.945074 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:17.941455    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6d8cdb99-xddtt"]
Jul 27 19:07:18.247937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:18.247898    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" path="/var/lib/kubelet/pods/09021ebe-54df-4145-8ae9-9c7cc405f5fa/volumes"
Jul 27 19:07:27.107722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:27.107695    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:07:27.111439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:27.111418    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f67cbfd8b-f6zwt"
Jul 27 19:07:28.546088 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.546048    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f8549cd45-2l42j" podUID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" containerName="console" containerID="cri-o://cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3" gracePeriod=15
Jul 27 19:07:28.805762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.805702    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:07:28.812575 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812553    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812706 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812591    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812706 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812622    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812706 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812665    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812721    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjjfq\" (UniqueName: \"kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812754    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config\") pod \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\" (UID: \"b5e31165-904f-44f5-8eb0-ec9f76d14d88\") "
Jul 27 19:07:28.812969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.812926    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:28.813037 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.813010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:28.813223 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.813204    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-oauth-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.813323 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.813228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config" (OuterVolumeSpecName: "console-config") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:28.814795 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.814767    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:28.814919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.814899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:07:28.814991 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.814967    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq" (OuterVolumeSpecName: "kube-api-access-rjjfq") pod "b5e31165-904f-44f5-8eb0-ec9f76d14d88" (UID: "b5e31165-904f-44f5-8eb0-ec9f76d14d88"). InnerVolumeSpecName "kube-api-access-rjjfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:28.913911 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.913879    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjjfq\" (UniqueName: \"kubernetes.io/projected/b5e31165-904f-44f5-8eb0-ec9f76d14d88-kube-api-access-rjjfq\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.913911 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.913905    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.913911 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.913919    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-serving-cert\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.914150 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.913932    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5e31165-904f-44f5-8eb0-ec9f76d14d88-service-ca\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.914150 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.913941    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5e31165-904f-44f5-8eb0-ec9f76d14d88-console-oauth-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:07:28.959608 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.959573    2558 generic.go:356] "Generic (PLEG): container finished" podID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" containerID="cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3" exitCode=0
Jul 27 19:07:28.959761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.959616    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f8549cd45-2l42j"
Jul 27 19:07:28.959761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.959667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8549cd45-2l42j" event={"ID":"b5e31165-904f-44f5-8eb0-ec9f76d14d88","Type":"ContainerDied","Data":"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"}
Jul 27 19:07:28.959761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.959707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f8549cd45-2l42j" event={"ID":"b5e31165-904f-44f5-8eb0-ec9f76d14d88","Type":"ContainerDied","Data":"3a8d6c564042110663f04257ca09aa48fabb3c0d2a53a2a1f992cd73153cb8d4"}
Jul 27 19:07:28.959761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.959725    2558 scope.go:117] "RemoveContainer" containerID="cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"
Jul 27 19:07:28.968050 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.968026    2558 scope.go:117] "RemoveContainer" containerID="cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"
Jul 27 19:07:28.968335 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:07:28.968318    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3\": container with ID starting with cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3 not found: ID does not exist" containerID="cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"
Jul 27 19:07:28.968409 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.968343    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3"} err="failed to get container status \"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3\": rpc error: code = NotFound desc = could not find container \"cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3\": container with ID starting with cc0c9a4c1ec3ef7635d7a11fc37cd5aa868aba89be1862fc7f08cf9faa93a4d3 not found: ID does not exist"
Jul 27 19:07:28.980722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.980700    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:07:28.984649 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:28.984627    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f8549cd45-2l42j"]
Jul 27 19:07:30.252864 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:30.249154    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" path="/var/lib/kubelet/pods/b5e31165-904f-44f5-8eb0-ec9f76d14d88/volumes"
Jul 27 19:07:48.961933 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:48.961894    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:07:48.981156 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:48.981131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:07:49.047773 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:07:49.047746    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:07.166543 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166508    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:07.166968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166791    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="prometheus" containerID="cri-o://4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4" gracePeriod=600
Jul 27 19:08:07.166968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166849    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-web" containerID="cri-o://e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841" gracePeriod=600
Jul 27 19:08:07.166968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166881    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="config-reloader" containerID="cri-o://9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812" gracePeriod=600
Jul 27 19:08:07.166968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166882    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697" gracePeriod=600
Jul 27 19:08:07.167205 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166832    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy" containerID="cri-o://a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502" gracePeriod=600
Jul 27 19:08:07.167205 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.166883    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="thanos-sidecar" containerID="cri-o://166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257" gracePeriod=600
Jul 27 19:08:07.421767 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.421703    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:07.534747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534719    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.534910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534760    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.534910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.534910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534820    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.534910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534852    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.534910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534921    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.534962    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535004    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535032    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535057    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535099    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lbdp\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535153    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.535209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535204    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535271    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535297    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535330    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535357    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535473    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1\") pod \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\" (UID: \"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e\") "
Jul 27 19:08:07.535651 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535536    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.535983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535847    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.535983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535868    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.536141 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.535989    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.536229 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.536194    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.536286 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.536246    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:08:07.536540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.536514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.537655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.537626    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.538497 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.538432    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:08:07.538728 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.538700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.538813 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.538765    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.539192 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.539494 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539449    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.539747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539699    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out" (OuterVolumeSpecName: "config-out") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:08:07.539747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539702    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.539747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539729    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp" (OuterVolumeSpecName: "kube-api-access-9lbdp") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "kube-api-access-9lbdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:08:07.539940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.539895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config" (OuterVolumeSpecName: "config") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.540410 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.540379    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.540841 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.540822    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.541401 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.541379    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:08:07.550571 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.550553    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config" (OuterVolumeSpecName: "web-config") pod "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" (UID: "70f4a2dd-a0bf-47e3-8aef-b7266ea0698e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:08:07.637096 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637070    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-kube-rbac-proxy\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637096 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637094    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637104    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637113    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lbdp\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-kube-api-access-9lbdp\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637121    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-metrics-client-ca\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637131    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637140    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-grpc-tls\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637148    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637157    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637184    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637193    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-tls-assets\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637201    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637208    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-config-out\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637217    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637224    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637232    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-prometheus-k8s-db\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637240    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-secret-metrics-client-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:07.637273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:07.637265    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e-web-config\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103213    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697" exitCode=0
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103234    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502" exitCode=0
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103240    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841" exitCode=0
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103246    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257" exitCode=0
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103251    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812" exitCode=0
Jul 27 19:08:08.103245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103256    2558 generic.go:356] "Generic (PLEG): container finished" podID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4" exitCode=0
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103297    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103306    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103408    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103466    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"}
Jul 27 19:08:08.103679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.103511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70f4a2dd-a0bf-47e3-8aef-b7266ea0698e","Type":"ContainerDied","Data":"aa0b0dbc6bba815062390a35c85562f01ae8566d4ade773cb88db8c99797c8fe"}
Jul 27 19:08:08.111345 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.111217    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.117900 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.117885    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.124298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.124279    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.130603 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.130571    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.133415 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.133394    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:08.137515 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.137481    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.140680 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.140659    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:08.144809 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.144782    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.153712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.153696    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.153962 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.153944    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.154017 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.153968    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.154017 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.153983    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.154222 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.154206    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.154265 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154227    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.154265 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154240    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.154475 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.154456    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.154526 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154479    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.154526 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154491    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.154702 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.154674    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.154740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154706    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.154740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154718    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.154958 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.154940    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.155009 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154963    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.155009 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.154981    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.155240 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.155224    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.155281 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155244    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.155281 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155256    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.155457 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:08:08.155443    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.155496 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155461    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.155496 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155472    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.155663 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155648    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.155703 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155664    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.155849 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155835    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.155891 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.155850    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.156052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156037    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.156052 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156050    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.156237 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.156284 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156237    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.156432 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156416    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.156481 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156433    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.156625 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156612    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.156677 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156625    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.156848 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156826    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.156848 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.156846    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.157061 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157045    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.157107 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157062    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.157264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157248    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.157264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157263    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.157483 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157464    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.157549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157483    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.157705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157688    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.157753 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157706    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.157916 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157901    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.157961 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.157917    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.158116 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158101    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.158159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158116    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.158315 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158301    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.158359 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158315    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.158517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158498    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.158553 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158516    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.158689 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158671    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.158735 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158690    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.158931 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158916    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.158931 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.158931    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.159248 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159232    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.159298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159248    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.159549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159530    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.159598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159549    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.159757 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159738    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.159796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159759    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.159968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159951    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.160014 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.159968    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.160180 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160149    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.160235 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160204    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.160425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160408    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.160474 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160426    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.160601 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160585    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.160601 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160600    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.160784 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160769    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.160833 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160784    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.160999 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.160978    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.161070 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161001    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.161260 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161242    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.161339 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161261    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.161482 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161463    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.161543 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161483    2558 scope.go:117] "RemoveContainer" containerID="4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"
Jul 27 19:08:08.161700 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161684    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697"} err="failed to get container status \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": rpc error: code = NotFound desc = could not find container \"4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697\": container with ID starting with 4da860fb6d6aaa2f5289f6b1eb3fdcefc52e529898b073d63737ad4b3ab8e697 not found: ID does not exist"
Jul 27 19:08:08.161767 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161702    2558 scope.go:117] "RemoveContainer" containerID="a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"
Jul 27 19:08:08.161899 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161883    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502"} err="failed to get container status \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": rpc error: code = NotFound desc = could not find container \"a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502\": container with ID starting with a25b5b7af9bb1bd1d374ecb793044413fb5d94d4b89ac7ef3f31274c6432f502 not found: ID does not exist"
Jul 27 19:08:08.161941 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.161899    2558 scope.go:117] "RemoveContainer" containerID="e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"
Jul 27 19:08:08.162130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162110    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841"} err="failed to get container status \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": rpc error: code = NotFound desc = could not find container \"e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841\": container with ID starting with e6170bcb8707cfc79f198d3f674b6fb5235e873fab8bad5ae7cd6c6ac916f841 not found: ID does not exist"
Jul 27 19:08:08.162199 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162130    2558 scope.go:117] "RemoveContainer" containerID="166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"
Jul 27 19:08:08.162351 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162336    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257"} err="failed to get container status \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": rpc error: code = NotFound desc = could not find container \"166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257\": container with ID starting with 166637b48048ba5efc8cdc06f31d0633ef9417dae37c033111be64de31003257 not found: ID does not exist"
Jul 27 19:08:08.162393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162353    2558 scope.go:117] "RemoveContainer" containerID="9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"
Jul 27 19:08:08.162533 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162510    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812"} err="failed to get container status \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": rpc error: code = NotFound desc = could not find container \"9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812\": container with ID starting with 9cb1a66ac1caa0c859492cb6be0504cf2547d11ee129722451a60e4b3a6a3812 not found: ID does not exist"
Jul 27 19:08:08.162574 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162536    2558 scope.go:117] "RemoveContainer" containerID="4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"
Jul 27 19:08:08.162738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162721    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4"} err="failed to get container status \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": rpc error: code = NotFound desc = could not find container \"4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4\": container with ID starting with 4a16ca0aece275ae4116c198b5681de3ce23e608a4e1806ed56bd3a880f204c4 not found: ID does not exist"
Jul 27 19:08:08.162789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162738    2558 scope.go:117] "RemoveContainer" containerID="433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"
Jul 27 19:08:08.162935 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.162918    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8"} err="failed to get container status \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": rpc error: code = NotFound desc = could not find container \"433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8\": container with ID starting with 433002caecdc2fb510e288aea2125f20e7a60a67f5120d6a65c57ca81538f5f8 not found: ID does not exist"
Jul 27 19:08:08.188680 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.188661    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:08.189132 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189114    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189135    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189148    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" containerName="console"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189156    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" containerName="console"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189182    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" containerName="console"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189191    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" containerName="console"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189211    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="prometheus"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189219    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="prometheus"
Jul 27 19:08:08.189231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189232    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="init-config-reloader"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189241    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="init-config-reloader"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189250    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-web"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189258    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-web"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189270    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-thanos"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189278    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-thanos"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189293    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="config-reloader"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189301    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="config-reloader"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189312    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" containerName="console"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189320    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" containerName="console"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189328    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="thanos-sidecar"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189336    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="thanos-sidecar"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189407    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09021ebe-54df-4145-8ae9-9c7cc405f5fa" containerName="console"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189418    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="config-reloader"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189426    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccf040c-fe1d-43b7-b3b3-76956e6d1267" containerName="console"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189440    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-thanos"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189450    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e31165-904f-44f5-8eb0-ec9f76d14d88" containerName="console"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189460    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="prometheus"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189468    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy-web"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189476    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="thanos-sidecar"
Jul 27 19:08:08.189600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.189483    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" containerName="kube-rbac-proxy"
Jul 27 19:08:08.194944 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.194924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.197760 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.197743    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 19:08:08.199227 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.198982    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 19:08:08.199227 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199062    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 19:08:08.199227 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.198984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 19:08:08.199227 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199185    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 19:08:08.199561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199349    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 19:08:08.199561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199375    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-pdvc9qif6t07\""
Jul 27 19:08:08.199561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199461    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 19:08:08.199561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199502    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 19:08:08.199736 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199563    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 19:08:08.199736 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199577    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 19:08:08.199736 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.199677    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fh8rs\""
Jul 27 19:08:08.200760 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.200720    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 19:08:08.200886 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.200851    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 19:08:08.205012 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.204995    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 19:08:08.210241 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.208014    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 19:08:08.222912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.222886    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:08.248704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.248675    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f4a2dd-a0bf-47e3-8aef-b7266ea0698e" path="/var/lib/kubelet/pods/70f4a2dd-a0bf-47e3-8aef-b7266ea0698e/volumes"
Jul 27 19:08:08.342982 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.342947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.342988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343336    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343886 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.343886 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.343712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vdd\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-kube-api-access-74vdd\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.444744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.444744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444700    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.444744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.444744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445029 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445029 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.444928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.445892 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446011 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74vdd\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-kube-api-access-74vdd\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.446530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.448573 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.448573 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.446920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.448573 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.447680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.448573 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.447639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.449452 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.447866    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.449615 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.447950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.449747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.447955    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.449876 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.448284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450000 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.448495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450120 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.445573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450275 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.448544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450275 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.449336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450685 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.450662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.450686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.450803 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.450777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.451078 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.451061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.451156 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.451139    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.451316 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.451299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.456203 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.456181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vdd\" (UniqueName: \"kubernetes.io/projected/ad4d8e33-9006-472b-9cb3-dd26b5acbf89-kube-api-access-74vdd\") pod \"prometheus-k8s-0\" (UID: \"ad4d8e33-9006-472b-9cb3-dd26b5acbf89\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.505214 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.505186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:08:08.663279 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:08.663256    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 19:08:08.665039 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:08:08.665015    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4d8e33_9006_472b_9cb3_dd26b5acbf89.slice/crio-20285941c8a93cd958f60e647429a8ef8e51a5bc15b8d9f1a6f402d1a2682652 WatchSource:0}: Error finding container 20285941c8a93cd958f60e647429a8ef8e51a5bc15b8d9f1a6f402d1a2682652: Status 404 returned error can't find the container with id 20285941c8a93cd958f60e647429a8ef8e51a5bc15b8d9f1a6f402d1a2682652
Jul 27 19:08:09.108253 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:09.108217    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad4d8e33-9006-472b-9cb3-dd26b5acbf89" containerID="cdaf46aa75cac850a84c7fb1af2be312e74c16578a1bb331e2f8636e692c9e2f" exitCode=0
Jul 27 19:08:09.108413 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:09.108310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerDied","Data":"cdaf46aa75cac850a84c7fb1af2be312e74c16578a1bb331e2f8636e692c9e2f"}
Jul 27 19:08:09.108413 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:09.108396    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"20285941c8a93cd958f60e647429a8ef8e51a5bc15b8d9f1a6f402d1a2682652"}
Jul 27 19:08:10.116581 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"49188f04cbeb1f6975c17037ff69eeab1a98444565cd8580f68c4cc6fb9e791a"}
Jul 27 19:08:10.117013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116608    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"eb84d998dff14233ec1ef518d01fdf48de1e51310d0b3fd4f0b16ad7cc9aaa7c"}
Jul 27 19:08:10.117013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"b0a8c49575bfa957e1a889f0dbfd581fa73b1d1c3bd4d6969242b7c8ce10f566"}
Jul 27 19:08:10.117013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116659    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"031213d745b2a37b9d5333bd421143792187408b00a5a0c05b1db68fdc530e3a"}
Jul 27 19:08:10.117013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"c82db4cd41567efcde2ad44fc141382008cd90b21d78412c7fb3b759ebd63c93"}
Jul 27 19:08:10.117013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.116709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad4d8e33-9006-472b-9cb3-dd26b5acbf89","Type":"ContainerStarted","Data":"ebdccd783c9ce694af2d6698de197f7eb592bb7a133a6710df8d659eb9b1965f"}
Jul 27 19:08:10.161290 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:10.161237    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.14315479 podStartE2EDuration="2.161218891s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.064101ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:08:10.159746343 +0000 UTC m=+172.355715431" watchObservedRunningTime="2026-07-27 19:08:10.161218891 +0000 UTC m=+172.357187980"
Jul 27 19:08:13.505882 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:08:13.505847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:09:08.505694 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:09:08.505658    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:09:08.521405 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:09:08.521384    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:09:09.348020 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:09:09.347992    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 19:10:12.942080 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.942044    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"]
Jul 27 19:10:12.945398 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.945378    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:12.952406 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:12.952381    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-61.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 27 19:10:12.953323 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.953308    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 19:10:12.955293 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:12.955269    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-132-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 27 19:10:12.957555 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.957540    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzws5\""
Jul 27 19:10:12.959980 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.959966    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 19:10:12.977368 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.977346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:12.977455 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.977384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:12.977455 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.977407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nssj\" (UniqueName: \"kubernetes.io/projected/15cd3c92-47d6-400e-93b0-641893211c00-kube-api-access-7nssj\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:12.977538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.977491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:12.977538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:12.977525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078337 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078643 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nssj\" (UniqueName: \"kubernetes.io/projected/15cd3c92-47d6-400e-93b0-641893211c00-kube-api-access-7nssj\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.078748 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.078728    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-manifests\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.080676 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.080656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15cd3c92-47d6-400e-93b0-641893211c00-tmp\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:13.093682 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:13.093660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"]
Jul 27 19:10:14.016884 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.016849    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 19:10:14.022388 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.022367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nssj\" (UniqueName: \"kubernetes.io/projected/15cd3c92-47d6-400e-93b0-641893211c00-kube-api-access-7nssj\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.079159 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:14.079126    2558 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 27 19:10:14.079331 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:14.079131    2558 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 27 19:10:14.079331 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:14.079224    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert podName:15cd3c92-47d6-400e-93b0-641893211c00 nodeName:}" failed. No retries permitted until 2026-07-27 19:10:14.579204849 +0000 UTC m=+296.775173918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert") pod "opendatahub-operator-controller-manager-9459789d9-mlm9z" (UID: "15cd3c92-47d6-400e-93b0-641893211c00") : failed to sync secret cache: timed out waiting for the condition
Jul 27 19:10:14.079331 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:10:14.079309    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert podName:15cd3c92-47d6-400e-93b0-641893211c00 nodeName:}" failed. No retries permitted until 2026-07-27 19:10:14.579287797 +0000 UTC m=+296.775256863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert") pod "opendatahub-operator-controller-manager-9459789d9-mlm9z" (UID: "15cd3c92-47d6-400e-93b0-641893211c00") : failed to sync secret cache: timed out waiting for the condition
Jul 27 19:10:14.301261 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.301143    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 19:10:14.592021 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.591933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.592021 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.591974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.594481 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.594448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-webhook-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.594612 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.594540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15cd3c92-47d6-400e-93b0-641893211c00-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9459789d9-mlm9z\" (UID: \"15cd3c92-47d6-400e-93b0-641893211c00\") " pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.755540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.755502    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:14.894198 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:14.892797    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"]
Jul 27 19:10:15.575407 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:15.575369    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z" event={"ID":"15cd3c92-47d6-400e-93b0-641893211c00","Type":"ContainerStarted","Data":"05956c2f54044d76807f9d34e76a0eca24164f9dcbc7cd5631ba9a7fc17a86ef"}
Jul 27 19:10:18.238236 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:18.238215    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 19:10:18.590372 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:18.590295    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z" event={"ID":"15cd3c92-47d6-400e-93b0-641893211c00","Type":"ContainerStarted","Data":"40e102f3458565b3c40d9b936e5fdfb3032c840610ea2c08f4fb9d186856f657"}
Jul 27 19:10:19.595365 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:19.595325    2558 generic.go:356] "Generic (PLEG): container finished" podID="15cd3c92-47d6-400e-93b0-641893211c00" containerID="40e102f3458565b3c40d9b936e5fdfb3032c840610ea2c08f4fb9d186856f657" exitCode=0
Jul 27 19:10:19.595760 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:19.595376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z" event={"ID":"15cd3c92-47d6-400e-93b0-641893211c00","Type":"ContainerDied","Data":"40e102f3458565b3c40d9b936e5fdfb3032c840610ea2c08f4fb9d186856f657"}
Jul 27 19:10:19.595975 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:19.595962    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:10:20.600849 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:20.600813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z" event={"ID":"15cd3c92-47d6-400e-93b0-641893211c00","Type":"ContainerStarted","Data":"8b609eac0ace659bcd3278c2e2c99ddf973eed1314e734071b5e3ef09f370ce8"}
Jul 27 19:10:20.601299 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:20.600947    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:20.621236 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:20.621191    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z" podStartSLOduration=3.7148159229999997 podStartE2EDuration="8.621156767s" totalImagesPullingTime="3.835164138s" totalInitContainerRuntime="1.071176706s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:20.619767108 +0000 UTC m=+302.815736198" watchObservedRunningTime="2026-07-27 19:10:20.621156767 +0000 UTC m=+302.817125855"
Jul 27 19:10:31.606679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:31.606645    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9459789d9-mlm9z"
Jul 27 19:10:34.007369 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.007340    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"]
Jul 27 19:10:34.021986 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.021963    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.024638 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.024611    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 19:10:34.024773 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.024722    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 19:10:34.024773 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.024725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pccvr\""
Jul 27 19:10:34.024893 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.024793    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 19:10:34.025350 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.025336    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 19:10:34.123616 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.123586    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"]
Jul 27 19:10:34.160003 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.159972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09542220-f6ff-433a-b919-033b029df572-tmp\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.160159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.160034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09542220-f6ff-433a-b919-033b029df572-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.160159 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.160054    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcp98\" (UniqueName: \"kubernetes.io/projected/09542220-f6ff-433a-b919-033b029df572-kube-api-access-tcp98\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.261362 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.261277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09542220-f6ff-433a-b919-033b029df572-tmp\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.261669 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.261646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09542220-f6ff-433a-b919-033b029df572-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.261793 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.261777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcp98\" (UniqueName: \"kubernetes.io/projected/09542220-f6ff-433a-b919-033b029df572-kube-api-access-tcp98\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.264934 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.264911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09542220-f6ff-433a-b919-033b029df572-tmp\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.265412 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.265390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09542220-f6ff-433a-b919-033b029df572-tls-certs\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.281616 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.281582    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcp98\" (UniqueName: \"kubernetes.io/projected/09542220-f6ff-433a-b919-033b029df572-kube-api-access-tcp98\") pod \"kube-auth-proxy-5dd59b47cf-88vhs\" (UID: \"09542220-f6ff-433a-b919-033b029df572\") " pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.331518 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.331489    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"
Jul 27 19:10:34.479574 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.479407    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs"]
Jul 27 19:10:34.482045 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:10:34.482023    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09542220_f6ff_433a_b919_033b029df572.slice/crio-378ccc37fc2250a4f165ee1ce700c65cb6aca7a6fb9aad387eeee85d8d83841c WatchSource:0}: Error finding container 378ccc37fc2250a4f165ee1ce700c65cb6aca7a6fb9aad387eeee85d8d83841c: Status 404 returned error can't find the container with id 378ccc37fc2250a4f165ee1ce700c65cb6aca7a6fb9aad387eeee85d8d83841c
Jul 27 19:10:34.657656 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:34.657578    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs" event={"ID":"09542220-f6ff-433a-b919-033b029df572","Type":"ContainerStarted","Data":"378ccc37fc2250a4f165ee1ce700c65cb6aca7a6fb9aad387eeee85d8d83841c"}
Jul 27 19:10:35.295631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.295597    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l8c4h"]
Jul 27 19:10:35.299324 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.299305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.301638 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.301615    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 19:10:35.314561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.314541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l8c4h"]
Jul 27 19:10:35.473537 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.473501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.473537 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.473536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9wm\" (UniqueName: \"kubernetes.io/projected/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-kube-api-access-4m9wm\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.574625 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.574519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.574625 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.574557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9wm\" (UniqueName: \"kubernetes.io/projected/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-kube-api-access-4m9wm\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.577606 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.577564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-tls-certs\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.588068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.588040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9wm\" (UniqueName: \"kubernetes.io/projected/cbbd8b34-591f-40e8-a7cb-be09fc0214b9-kube-api-access-4m9wm\") pod \"model-serving-api-54d89bd5fc-l8c4h\" (UID: \"cbbd8b34-591f-40e8-a7cb-be09fc0214b9\") " pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.612879 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.612855    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:35.762728 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:35.762698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-l8c4h"]
Jul 27 19:10:35.764684 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:10:35.764662    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbd8b34_591f_40e8_a7cb_be09fc0214b9.slice/crio-222a9eeaafa1b995560891901d11e17fb210ec3dd4a085bcb359650200cb5f16 WatchSource:0}: Error finding container 222a9eeaafa1b995560891901d11e17fb210ec3dd4a085bcb359650200cb5f16: Status 404 returned error can't find the container with id 222a9eeaafa1b995560891901d11e17fb210ec3dd4a085bcb359650200cb5f16
Jul 27 19:10:36.670249 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:36.670201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h" event={"ID":"cbbd8b34-591f-40e8-a7cb-be09fc0214b9","Type":"ContainerStarted","Data":"222a9eeaafa1b995560891901d11e17fb210ec3dd4a085bcb359650200cb5f16"}
Jul 27 19:10:37.056434 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.056402    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"]
Jul 27 19:10:37.061047 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.061026    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.068207 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.068160    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 19:10:37.069341 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.069317    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 19:10:37.076351 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.076330    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"]
Jul 27 19:10:37.085806 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.085770    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mbblb\""
Jul 27 19:10:37.087034 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.087014    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 19:10:37.087131 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.087019    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 19:10:37.087203 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.087158    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 19:10:37.190420 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.190383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.190420 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.190429    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.190655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.190448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcm8h\" (UniqueName: \"kubernetes.io/projected/79723fa8-2d51-4c17-a433-080754fe065b-kube-api-access-tcm8h\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.190655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.190501    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79723fa8-2d51-4c17-a433-080754fe065b-manager-config\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.291553 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.291524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.291719 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.291559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.291719 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.291585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcm8h\" (UniqueName: \"kubernetes.io/projected/79723fa8-2d51-4c17-a433-080754fe065b-kube-api-access-tcm8h\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.291719 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.291611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79723fa8-2d51-4c17-a433-080754fe065b-manager-config\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.292409 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.292382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79723fa8-2d51-4c17-a433-080754fe065b-manager-config\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.294463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.294441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-metrics-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.294463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.294452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79723fa8-2d51-4c17-a433-080754fe065b-cert\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.300678 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.300656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcm8h\" (UniqueName: \"kubernetes.io/projected/79723fa8-2d51-4c17-a433-080754fe065b-kube-api-access-tcm8h\") pod \"lws-controller-manager-6898ff9d7-pggld\" (UID: \"79723fa8-2d51-4c17-a433-080754fe065b\") " pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.372789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.372700    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:37.573976 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.573953    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"]
Jul 27 19:10:37.578207 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:10:37.578154    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79723fa8_2d51_4c17_a433_080754fe065b.slice/crio-3b97ade2d62dd513b67911c6cb0048a641c86e1e87b7d26aa03423d698d7a272 WatchSource:0}: Error finding container 3b97ade2d62dd513b67911c6cb0048a641c86e1e87b7d26aa03423d698d7a272: Status 404 returned error can't find the container with id 3b97ade2d62dd513b67911c6cb0048a641c86e1e87b7d26aa03423d698d7a272
Jul 27 19:10:37.677823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.677741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs" event={"ID":"09542220-f6ff-433a-b919-033b029df572","Type":"ContainerStarted","Data":"99fb57701c4b7f65470aae6689087d640fae6d8de859284493deff00b6ad1f66"}
Jul 27 19:10:37.678972 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.678950    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld" event={"ID":"79723fa8-2d51-4c17-a433-080754fe065b","Type":"ContainerStarted","Data":"3b97ade2d62dd513b67911c6cb0048a641c86e1e87b7d26aa03423d698d7a272"}
Jul 27 19:10:37.697650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:37.697606    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd59b47cf-88vhs" podStartSLOduration=1.6849521520000001 podStartE2EDuration="4.697591145s" totalImagesPullingTime="3.012638993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:37.693965658 +0000 UTC m=+319.889934747" watchObservedRunningTime="2026-07-27 19:10:37.697591145 +0000 UTC m=+319.893560233"
Jul 27 19:10:38.688398 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:38.688325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h" event={"ID":"cbbd8b34-591f-40e8-a7cb-be09fc0214b9","Type":"ContainerStarted","Data":"7407d54e57e4dfea91dfceeb80068491137d4e5565eef0f4c396964cbf86a3c3"}
Jul 27 19:10:38.708726 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:38.708661    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h" podStartSLOduration=1.456987686 podStartE2EDuration="3.708638288s" totalImagesPullingTime="2.251650602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:38.706473541 +0000 UTC m=+320.902442653" watchObservedRunningTime="2026-07-27 19:10:38.708638288 +0000 UTC m=+320.904607379"
Jul 27 19:10:39.692849 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:39.692820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:40.698697 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:40.698662    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld" event={"ID":"79723fa8-2d51-4c17-a433-080754fe065b","Type":"ContainerStarted","Data":"66ca620b260dcbe1ac3077d6d9bea6c36f3e78df19e9aabe817cfc3c04f01460"}
Jul 27 19:10:40.723471 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:40.723414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld" podStartSLOduration=1.13180634 podStartE2EDuration="3.723394941s" totalImagesPullingTime="2.591588601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:10:40.721052704 +0000 UTC m=+322.917021791" watchObservedRunningTime="2026-07-27 19:10:40.723394941 +0000 UTC m=+322.919364032"
Jul 27 19:10:41.707243 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:41.707198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:10:50.703382 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:50.703355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-l8c4h"
Jul 27 19:10:52.713092 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:10:52.713065    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6898ff9d7-pggld"
Jul 27 19:12:17.934990 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.934958    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"]
Jul 27 19:12:17.938283 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.938266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:17.940702 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.940683    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:12:17.940819 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.940799    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:12:17.940881 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.940843    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7vb5f\""
Jul 27 19:12:17.958100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:17.958074    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"]
Jul 27 19:12:18.055708 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.055680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8s4\" (UniqueName: \"kubernetes.io/projected/6626ff50-2877-43c5-bf1c-9e832ef1472d-kube-api-access-cz8s4\") pod \"authorino-operator-75cc8d5cb7-ggkf5\" (UID: \"6626ff50-2877-43c5-bf1c-9e832ef1472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:18.156962 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.156929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8s4\" (UniqueName: \"kubernetes.io/projected/6626ff50-2877-43c5-bf1c-9e832ef1472d-kube-api-access-cz8s4\") pod \"authorino-operator-75cc8d5cb7-ggkf5\" (UID: \"6626ff50-2877-43c5-bf1c-9e832ef1472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:18.165320 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.165301    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 19:12:18.175518 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.175501    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 19:12:18.185843 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.185784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8s4\" (UniqueName: \"kubernetes.io/projected/6626ff50-2877-43c5-bf1c-9e832ef1472d-kube-api-access-cz8s4\") pod \"authorino-operator-75cc8d5cb7-ggkf5\" (UID: \"6626ff50-2877-43c5-bf1c-9e832ef1472d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:18.250408 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.250386    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7vb5f\""
Jul 27 19:12:18.259289 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.259267    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:18.393421 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:18.393397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"]
Jul 27 19:12:18.396183 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:12:18.396140    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6626ff50_2877_43c5_bf1c_9e832ef1472d.slice/crio-afb8bf90dba66d3989c1e848a70b0361dba4d1162babcd171ac241c9c14c1236 WatchSource:0}: Error finding container afb8bf90dba66d3989c1e848a70b0361dba4d1162babcd171ac241c9c14c1236: Status 404 returned error can't find the container with id afb8bf90dba66d3989c1e848a70b0361dba4d1162babcd171ac241c9c14c1236
Jul 27 19:12:19.099610 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:19.099577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5" event={"ID":"6626ff50-2877-43c5-bf1c-9e832ef1472d","Type":"ContainerStarted","Data":"afb8bf90dba66d3989c1e848a70b0361dba4d1162babcd171ac241c9c14c1236"}
Jul 27 19:12:21.110774 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:21.110733    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5" event={"ID":"6626ff50-2877-43c5-bf1c-9e832ef1472d","Type":"ContainerStarted","Data":"634c8dedb9d700e37e0443e5631149dc573d836588c75467c8c61f1a2b609255"}
Jul 27 19:12:21.111232 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:21.110823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:21.127375 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:21.127328    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5" podStartSLOduration=1.8832349750000001 podStartE2EDuration="4.127314496s" totalImagesPullingTime="2.244079521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:21.126481507 +0000 UTC m=+423.322450593" watchObservedRunningTime="2026-07-27 19:12:21.127314496 +0000 UTC m=+423.323283584"
Jul 27 19:12:32.116990 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:32.116961    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ggkf5"
Jul 27 19:12:44.473782 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.473706    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:12:44.476957 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.476941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.479527 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.479507    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b6r4n\""
Jul 27 19:12:44.492823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.492800    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:12:44.593575 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.593548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.593697 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.593628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hwk\" (UniqueName: \"kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.694370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.694346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.694496 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.694424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hwk\" (UniqueName: \"kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.694698 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.694677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.702965 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.702939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hwk\" (UniqueName: \"kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk\") pod \"kuadrant-operator-controller-manager-86878c769f-878x5\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.787700 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.787679    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:44.917727 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:44.917703    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:12:44.920145 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:12:44.920115    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35cb16a9_e1ad_474b_b677_d8d3466cf0e3.slice/crio-9e2c7b2731572045aa54fb27f73221f954f8131e06a56a3c5cac8721b7b11005 WatchSource:0}: Error finding container 9e2c7b2731572045aa54fb27f73221f954f8131e06a56a3c5cac8721b7b11005: Status 404 returned error can't find the container with id 9e2c7b2731572045aa54fb27f73221f954f8131e06a56a3c5cac8721b7b11005
Jul 27 19:12:45.215133 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:45.215051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" event={"ID":"35cb16a9-e1ad-474b-b677-d8d3466cf0e3","Type":"ContainerStarted","Data":"9e2c7b2731572045aa54fb27f73221f954f8131e06a56a3c5cac8721b7b11005"}
Jul 27 19:12:51.246020 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:51.245985    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" event={"ID":"35cb16a9-e1ad-474b-b677-d8d3466cf0e3","Type":"ContainerStarted","Data":"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"}
Jul 27 19:12:51.246436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:51.246140    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:12:51.265355 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:12:51.265296    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" podStartSLOduration=1.62064181 podStartE2EDuration="7.265282544s" totalImagesPullingTime="5.644640734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:51.26360044 +0000 UTC m=+453.459569529" watchObservedRunningTime="2026-07-27 19:12:51.265282544 +0000 UTC m=+453.461251632"
Jul 27 19:13:02.252430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:02.252398    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:13:23.087803 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.087766    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:13:23.093010 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.092984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:23.095345 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.095327    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n8q5m\""
Jul 27 19:13:23.099568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.099546    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:13:23.121140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.121116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tsrh\" (UniqueName: \"kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh\") pod \"authorino-75d556bd77-z5zxc\" (UID: \"7723c117-baa1-49fc-8c76-76fd48a81f87\") " pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:23.221733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.221698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tsrh\" (UniqueName: \"kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh\") pod \"authorino-75d556bd77-z5zxc\" (UID: \"7723c117-baa1-49fc-8c76-76fd48a81f87\") " pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:23.232641 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.232612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tsrh\" (UniqueName: \"kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh\") pod \"authorino-75d556bd77-z5zxc\" (UID: \"7723c117-baa1-49fc-8c76-76fd48a81f87\") " pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:23.410752 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.410671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:23.535487 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:23.535467    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:13:23.537556 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:13:23.537532    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7723c117_baa1_49fc_8c76_76fd48a81f87.slice/crio-1828e39405601663b9ac2a992a4c259a2567b298aa21fb95a1f519c7796931a3 WatchSource:0}: Error finding container 1828e39405601663b9ac2a992a4c259a2567b298aa21fb95a1f519c7796931a3: Status 404 returned error can't find the container with id 1828e39405601663b9ac2a992a4c259a2567b298aa21fb95a1f519c7796931a3
Jul 27 19:13:24.391126 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:24.391088    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5zxc" event={"ID":"7723c117-baa1-49fc-8c76-76fd48a81f87","Type":"ContainerStarted","Data":"1828e39405601663b9ac2a992a4c259a2567b298aa21fb95a1f519c7796931a3"}
Jul 27 19:13:27.407068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:27.407030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5zxc" event={"ID":"7723c117-baa1-49fc-8c76-76fd48a81f87","Type":"ContainerStarted","Data":"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"}
Jul 27 19:13:27.422905 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:27.422856    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z5zxc" podStartSLOduration=1.452801266 podStartE2EDuration="4.422840315s" totalImagesPullingTime="2.970039049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:27.422715966 +0000 UTC m=+489.618685053" watchObservedRunningTime="2026-07-27 19:13:27.422840315 +0000 UTC m=+489.618809404"
Jul 27 19:13:57.732647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:57.732616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:13:57.733049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:57.732818    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z5zxc" podUID="7723c117-baa1-49fc-8c76-76fd48a81f87" containerName="authorino" containerID="cri-o://b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a" gracePeriod=30
Jul 27 19:13:57.983392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:57.983333    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:58.030163 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.030136    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tsrh\" (UniqueName: \"kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh\") pod \"7723c117-baa1-49fc-8c76-76fd48a81f87\" (UID: \"7723c117-baa1-49fc-8c76-76fd48a81f87\") "
Jul 27 19:13:58.032427 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.032398    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh" (OuterVolumeSpecName: "kube-api-access-6tsrh") pod "7723c117-baa1-49fc-8c76-76fd48a81f87" (UID: "7723c117-baa1-49fc-8c76-76fd48a81f87"). InnerVolumeSpecName "kube-api-access-6tsrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:58.130680 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.130647    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tsrh\" (UniqueName: \"kubernetes.io/projected/7723c117-baa1-49fc-8c76-76fd48a81f87-kube-api-access-6tsrh\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:13:58.543983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.543899    2558 generic.go:356] "Generic (PLEG): container finished" podID="7723c117-baa1-49fc-8c76-76fd48a81f87" containerID="b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a" exitCode=0
Jul 27 19:13:58.543983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.543952    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z5zxc"
Jul 27 19:13:58.544149 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.543983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5zxc" event={"ID":"7723c117-baa1-49fc-8c76-76fd48a81f87","Type":"ContainerDied","Data":"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"}
Jul 27 19:13:58.544149 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.544027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z5zxc" event={"ID":"7723c117-baa1-49fc-8c76-76fd48a81f87","Type":"ContainerDied","Data":"1828e39405601663b9ac2a992a4c259a2567b298aa21fb95a1f519c7796931a3"}
Jul 27 19:13:58.544149 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.544043    2558 scope.go:117] "RemoveContainer" containerID="b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"
Jul 27 19:13:58.552232 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.552211    2558 scope.go:117] "RemoveContainer" containerID="b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"
Jul 27 19:13:58.552529 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:13:58.552501    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a\": container with ID starting with b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a not found: ID does not exist" containerID="b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"
Jul 27 19:13:58.552602 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.552530    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a"} err="failed to get container status \"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a\": rpc error: code = NotFound desc = could not find container \"b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a\": container with ID starting with b08315cdae1617c9ecced5a3a177836ed659968255287aa739687136b16fa15a not found: ID does not exist"
Jul 27 19:13:58.568380 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.568355    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:13:58.572985 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:13:58.572967    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z5zxc"]
Jul 27 19:14:00.249187 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:14:00.249129    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7723c117-baa1-49fc-8c76-76fd48a81f87" path="/var/lib/kubelet/pods/7723c117-baa1-49fc-8c76-76fd48a81f87/volumes"
Jul 27 19:15:33.058868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.056072    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"]
Jul 27 19:15:33.058868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.056610    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7723c117-baa1-49fc-8c76-76fd48a81f87" containerName="authorino"
Jul 27 19:15:33.058868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.056629    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7723c117-baa1-49fc-8c76-76fd48a81f87" containerName="authorino"
Jul 27 19:15:33.058868 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.056734    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7723c117-baa1-49fc-8c76-76fd48a81f87" containerName="authorino"
Jul 27 19:15:33.061533 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.060329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.063069 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.063046    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 19:15:33.063282 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.063261    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 19:15:33.063526 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.063501    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 19:15:33.063633 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.063556    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtjpv\""
Jul 27 19:15:33.076340 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.076313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"]
Jul 27 19:15:33.151527 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.151527 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12944852-a01e-4bf4-b1da-2310886e0ba0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.151731 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.151731 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grpjj\" (UniqueName: \"kubernetes.io/projected/12944852-a01e-4bf4-b1da-2310886e0ba0-kube-api-access-grpjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.151731 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.151731 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.151686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.252992 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.252960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253129 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grpjj\" (UniqueName: \"kubernetes.io/projected/12944852-a01e-4bf4-b1da-2310886e0ba0-kube-api-access-grpjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253129 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253292 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253292 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12944852-a01e-4bf4-b1da-2310886e0ba0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253381    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.253573 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.253552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.255535 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.255515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/12944852-a01e-4bf4-b1da-2310886e0ba0-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.255664 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.255648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12944852-a01e-4bf4-b1da-2310886e0ba0-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.265390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.265364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grpjj\" (UniqueName: \"kubernetes.io/projected/12944852-a01e-4bf4-b1da-2310886e0ba0-kube-api-access-grpjj\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8dfbp\" (UID: \"12944852-a01e-4bf4-b1da-2310886e0ba0\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.374749 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.374666    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:33.505947 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.505885    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"]
Jul 27 19:15:33.508239 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:15:33.508204    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12944852_a01e_4bf4_b1da_2310886e0ba0.slice/crio-960b202bfc6ca7e2b1848a46974291c9e919e16201d461e6888da5e4e8cefe3e WatchSource:0}: Error finding container 960b202bfc6ca7e2b1848a46974291c9e919e16201d461e6888da5e4e8cefe3e: Status 404 returned error can't find the container with id 960b202bfc6ca7e2b1848a46974291c9e919e16201d461e6888da5e4e8cefe3e
Jul 27 19:15:33.509696 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.509676    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:15:33.949689 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:33.949643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp" event={"ID":"12944852-a01e-4bf4-b1da-2310886e0ba0","Type":"ContainerStarted","Data":"960b202bfc6ca7e2b1848a46974291c9e919e16201d461e6888da5e4e8cefe3e"}
Jul 27 19:15:34.955655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:34.955566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp" event={"ID":"12944852-a01e-4bf4-b1da-2310886e0ba0","Type":"ContainerStarted","Data":"ab8af01d303caac184e19747aa75933e23f1aaf4990ca15b47a6ce2dc29fa75c"}
Jul 27 19:15:34.973484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:34.973432    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp" podStartSLOduration=0.887023301 podStartE2EDuration="1.973412775s" totalImagesPullingTime="1.086389474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:34.971821055 +0000 UTC m=+617.167790143" watchObservedRunningTime="2026-07-27 19:15:34.973412775 +0000 UTC m=+617.169381863"
Jul 27 19:15:38.940475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:38.940442    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"]
Jul 27 19:15:38.944541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:38.944519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:38.947536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:38.947514    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 27 19:15:38.953771 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:38.953748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"]
Jul 27 19:15:39.007712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.007830 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007744    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.007830 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.007904 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.007904 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f9625d-364b-4d40-a3e0-92ba0833023b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.007904 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.007887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6pgw\" (UniqueName: \"kubernetes.io/projected/a8f9625d-364b-4d40-a3e0-92ba0833023b-kube-api-access-m6pgw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109312 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109469 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109469 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f9625d-364b-4d40-a3e0-92ba0833023b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109469 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6pgw\" (UniqueName: \"kubernetes.io/projected/a8f9625d-364b-4d40-a3e0-92ba0833023b-kube-api-access-m6pgw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109742 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109844 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.109940 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.109921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.111771 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.111751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8f9625d-364b-4d40-a3e0-92ba0833023b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.112038 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.112017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8f9625d-364b-4d40-a3e0-92ba0833023b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.118989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.118969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6pgw\" (UniqueName: \"kubernetes.io/projected/a8f9625d-364b-4d40-a3e0-92ba0833023b-kube-api-access-m6pgw\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw\" (UID: \"a8f9625d-364b-4d40-a3e0-92ba0833023b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.262895 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.262865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:39.396856 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.396819    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"]
Jul 27 19:15:39.398475 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:15:39.398451    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f9625d_364b_4d40_a3e0_92ba0833023b.slice/crio-f54b0d736699c4aa26592a52c42e487cb1544ffdb50a6a6881b229bb8c2b3c96 WatchSource:0}: Error finding container f54b0d736699c4aa26592a52c42e487cb1544ffdb50a6a6881b229bb8c2b3c96: Status 404 returned error can't find the container with id f54b0d736699c4aa26592a52c42e487cb1544ffdb50a6a6881b229bb8c2b3c96
Jul 27 19:15:39.978962 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.978927    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw" event={"ID":"a8f9625d-364b-4d40-a3e0-92ba0833023b","Type":"ContainerStarted","Data":"9ea1e82e00db2cb3189809295fd721618cd946f6383a3a45b2b059dbc9037603"}
Jul 27 19:15:39.979502 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.978969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw" event={"ID":"a8f9625d-364b-4d40-a3e0-92ba0833023b","Type":"ContainerStarted","Data":"f54b0d736699c4aa26592a52c42e487cb1544ffdb50a6a6881b229bb8c2b3c96"}
Jul 27 19:15:39.999314 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:39.999270    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw" podStartSLOduration=1.799710342 podStartE2EDuration="1.999253489s" totalImagesPullingTime="199.543147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:15:39.997828193 +0000 UTC m=+622.193797276" watchObservedRunningTime="2026-07-27 19:15:39.999253489 +0000 UTC m=+622.195222595"
Jul 27 19:15:43.375231 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:43.375198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:43.375673 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:43.375267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:43.387476 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:43.387457    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:44.007367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:44.007338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8dfbp"
Jul 27 19:15:49.263110 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:49.263076    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:49.263641 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:49.263122    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:49.281031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:49.281006    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:15:50.034261 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:15:50.034231    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw"
Jul 27 19:24:10.607988 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:10.607948    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:24:10.608648 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:10.608184    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" podUID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" containerName="manager" containerID="cri-o://f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb" gracePeriod=10
Jul 27 19:24:13.161219 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.161194    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:24:13.228421 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.228391    2558 generic.go:356] "Generic (PLEG): container finished" podID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" containerID="f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb" exitCode=0
Jul 27 19:24:13.228561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.228430    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"
Jul 27 19:24:13.228561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.228465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" event={"ID":"35cb16a9-e1ad-474b-b677-d8d3466cf0e3","Type":"ContainerDied","Data":"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"}
Jul 27 19:24:13.228561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.228512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5" event={"ID":"35cb16a9-e1ad-474b-b677-d8d3466cf0e3","Type":"ContainerDied","Data":"9e2c7b2731572045aa54fb27f73221f954f8131e06a56a3c5cac8721b7b11005"}
Jul 27 19:24:13.228561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.228537    2558 scope.go:117] "RemoveContainer" containerID="f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"
Jul 27 19:24:13.237439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.237421    2558 scope.go:117] "RemoveContainer" containerID="f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"
Jul 27 19:24:13.237688 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:24:13.237669    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb\": container with ID starting with f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb not found: ID does not exist" containerID="f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"
Jul 27 19:24:13.237754 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.237713    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb"} err="failed to get container status \"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb\": rpc error: code = NotFound desc = could not find container \"f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb\": container with ID starting with f600df41779fb49064dc2dfe1c4f02b268f5048acb061c3d7f93b87cfaecc9eb not found: ID does not exist"
Jul 27 19:24:13.280780 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.280730    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume\") pod \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") "
Jul 27 19:24:13.280871 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.280784    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44hwk\" (UniqueName: \"kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk\") pod \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\" (UID: \"35cb16a9-e1ad-474b-b677-d8d3466cf0e3\") "
Jul 27 19:24:13.281145 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.281119    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35cb16a9-e1ad-474b-b677-d8d3466cf0e3" (UID: "35cb16a9-e1ad-474b-b677-d8d3466cf0e3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:24:13.282920 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.282900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk" (OuterVolumeSpecName: "kube-api-access-44hwk") pod "35cb16a9-e1ad-474b-b677-d8d3466cf0e3" (UID: "35cb16a9-e1ad-474b-b677-d8d3466cf0e3"). InnerVolumeSpecName "kube-api-access-44hwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:24:13.388570 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.388540    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-extensions-socket-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:24:13.388570 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.388565    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44hwk\" (UniqueName: \"kubernetes.io/projected/35cb16a9-e1ad-474b-b677-d8d3466cf0e3-kube-api-access-44hwk\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:24:13.550075 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.550050    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:24:13.554620 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:13.554596    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-878x5"]
Jul 27 19:24:14.248994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:24:14.248953    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" path="/var/lib/kubelet/pods/35cb16a9-e1ad-474b-b677-d8d3466cf0e3/volumes"
Jul 27 19:25:11.808133 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.808051    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"]
Jul 27 19:25:11.808607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.808477    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" containerName="manager"
Jul 27 19:25:11.808607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.808490    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" containerName="manager"
Jul 27 19:25:11.808607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.808552    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="35cb16a9-e1ad-474b-b677-d8d3466cf0e3" containerName="manager"
Jul 27 19:25:11.811762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.811743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.814036 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.814016    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b6r4n\""
Jul 27 19:25:11.823100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.823079    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"]
Jul 27 19:25:11.875636 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.875607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36522525-ecfa-4abf-9eef-a6d0714edc87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.875794 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.875643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmfkc\" (UniqueName: \"kubernetes.io/projected/36522525-ecfa-4abf-9eef-a6d0714edc87-kube-api-access-pmfkc\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.976484 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.976451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36522525-ecfa-4abf-9eef-a6d0714edc87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.976650 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.976493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmfkc\" (UniqueName: \"kubernetes.io/projected/36522525-ecfa-4abf-9eef-a6d0714edc87-kube-api-access-pmfkc\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.976835 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.976813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36522525-ecfa-4abf-9eef-a6d0714edc87-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:11.984811 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:11.984789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmfkc\" (UniqueName: \"kubernetes.io/projected/36522525-ecfa-4abf-9eef-a6d0714edc87-kube-api-access-pmfkc\") pod \"kuadrant-operator-controller-manager-86878c769f-799mt\" (UID: \"36522525-ecfa-4abf-9eef-a6d0714edc87\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:12.122359 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.122280    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:12.260139 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.260115    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"]
Jul 27 19:25:12.262862 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:25:12.262830    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36522525_ecfa_4abf_9eef_a6d0714edc87.slice/crio-3f73793257a525a987f2d52a8c71b56f6c62e6dfe2229e89c450dc6341cc3141 WatchSource:0}: Error finding container 3f73793257a525a987f2d52a8c71b56f6c62e6dfe2229e89c450dc6341cc3141: Status 404 returned error can't find the container with id 3f73793257a525a987f2d52a8c71b56f6c62e6dfe2229e89c450dc6341cc3141
Jul 27 19:25:12.481681 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.481644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt" event={"ID":"36522525-ecfa-4abf-9eef-a6d0714edc87","Type":"ContainerStarted","Data":"6f9c148a080fcd3297a06d8f8f76ab2e37854db05e84551bdcb79cc8cd61f9c4"}
Jul 27 19:25:12.481828 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.481702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt" event={"ID":"36522525-ecfa-4abf-9eef-a6d0714edc87","Type":"ContainerStarted","Data":"3f73793257a525a987f2d52a8c71b56f6c62e6dfe2229e89c450dc6341cc3141"}
Jul 27 19:25:12.481828 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.481758    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:25:12.500763 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:12.500717    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt" podStartSLOduration=1.500701164 podStartE2EDuration="1.500701164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:12.498701746 +0000 UTC m=+1194.694670856" watchObservedRunningTime="2026-07-27 19:25:12.500701164 +0000 UTC m=+1194.696670252"
Jul 27 19:25:23.488591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:25:23.488565    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-799mt"
Jul 27 19:27:52.863457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.863381    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:27:52.866667 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.866650    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.869416 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.869392    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-48d4dc3d-kserve-self-signed-certs\""
Jul 27 19:27:52.885828 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.885802    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:27:52.910955 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.910927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.911089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.910963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.911089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.911043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.911089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.911073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.911209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.911110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:52.911209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:52.911132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xb7\" (UniqueName: \"kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011516 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011516 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011730 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011730 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xb7\" (UniqueName: \"kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011730 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011730 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.011955 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.012006 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.011975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.012079 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.012065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.014050 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.014028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.014213 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.014195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.019968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.019950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xb7\" (UniqueName: \"kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7\") pod \"e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") " pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.175631 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.175528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:27:53.305049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:53.305023    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:27:53.307211 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:27:53.307180    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4bfbe65_9191_4700_aadb_8974c8abcd56.slice/crio-0f1fee0372c6d80077f8b8743af311e59cd88b62090730a8c1171600b52f3b08 WatchSource:0}: Error finding container 0f1fee0372c6d80077f8b8743af311e59cd88b62090730a8c1171600b52f3b08: Status 404 returned error can't find the container with id 0f1fee0372c6d80077f8b8743af311e59cd88b62090730a8c1171600b52f3b08
Jul 27 19:27:54.196146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:54.196110    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" event={"ID":"f4bfbe65-9191-4700-aadb-8974c8abcd56","Type":"ContainerStarted","Data":"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"}
Jul 27 19:27:54.196146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:54.196148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" event={"ID":"f4bfbe65-9191-4700-aadb-8974c8abcd56","Type":"ContainerStarted","Data":"0f1fee0372c6d80077f8b8743af311e59cd88b62090730a8c1171600b52f3b08"}
Jul 27 19:27:54.213831 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:27:54.213777    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" podStartSLOduration=2.213761509 podStartE2EDuration="2.213761509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:54.212240772 +0000 UTC m=+1356.408209862" watchObservedRunningTime="2026-07-27 19:27:54.213761509 +0000 UTC m=+1356.409730596"
Jul 27 19:28:03.176080 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:03.175997    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:28:03.176080 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:03.176045    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:28:03.188553 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:03.188533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:28:03.248184 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:03.248145    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:28:08.149308 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.149269    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:28:08.152971 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.152950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.155432 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.155412    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-48d4dc3d-kserve-self-signed-certs\""
Jul 27 19:28:08.160915 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.160897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:28:08.245094 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.245257 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p4w\" (UniqueName: \"kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.245257 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.245257 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.245257 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.245428 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.245276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346520 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346488    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346520 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p4w\" (UniqueName: \"kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346705    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.346930 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.346892    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.347034 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.347006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.347203 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.347188    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.349044 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.349022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.349291 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.349271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.356588 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.356570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p4w\" (UniqueName: \"kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w\") pod \"e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") " pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.462815 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.462733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:08.595832 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:08.595810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:28:08.597562 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:28:08.597534    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72e802de_3561_4101_86e0_60e1ebc31a9d.slice/crio-360fa2496960082dc4da010e3bdbf4d9dcd60096b476e1dcd3b52497879d4894 WatchSource:0}: Error finding container 360fa2496960082dc4da010e3bdbf4d9dcd60096b476e1dcd3b52497879d4894: Status 404 returned error can't find the container with id 360fa2496960082dc4da010e3bdbf4d9dcd60096b476e1dcd3b52497879d4894
Jul 27 19:28:09.264022 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:09.263983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" event={"ID":"72e802de-3561-4101-86e0-60e1ebc31a9d","Type":"ContainerStarted","Data":"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"}
Jul 27 19:28:09.264410 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:09.264029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" event={"ID":"72e802de-3561-4101-86e0-60e1ebc31a9d","Type":"ContainerStarted","Data":"360fa2496960082dc4da010e3bdbf4d9dcd60096b476e1dcd3b52497879d4894"}
Jul 27 19:28:09.281344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:09.281290    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" podStartSLOduration=1.281270636 podStartE2EDuration="1.281270636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:09.28082276 +0000 UTC m=+1371.476791849" watchObservedRunningTime="2026-07-27 19:28:09.281270636 +0000 UTC m=+1371.477239727"
Jul 27 19:28:18.463338 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:18.463302    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:18.463338 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:18.463340    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:18.475652 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:18.475632    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:19.319192 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:19.319143    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:28:55.569385 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:55.569353    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:28:56.994577 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:28:56.994544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:29:10.589104 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:10.589023    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" podUID="f4bfbe65-9191-4700-aadb-8974c8abcd56" containerName="main" containerID="cri-o://6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393" gracePeriod=45
Jul 27 19:29:10.842804 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:10.842753    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:29:11.018869 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.018832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019027 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.018926    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6xb7\" (UniqueName: \"kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019054    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019102 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019090    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019135 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019108    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:11.019200 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019147    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019241 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019208    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm\") pod \"f4bfbe65-9191-4700-aadb-8974c8abcd56\" (UID: \"f4bfbe65-9191-4700-aadb-8974c8abcd56\") "
Jul 27 19:29:11.019398 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019375    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home" (OuterVolumeSpecName: "home") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:11.019479 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019388    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:11.019561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019539    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.019821 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019572    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.019821 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.019588    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.021530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.021484    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:11.021642 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.021571    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7" (OuterVolumeSpecName: "kube-api-access-c6xb7") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "kube-api-access-c6xb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:11.021642 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.021571    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm" (OuterVolumeSpecName: "dshm") pod "f4bfbe65-9191-4700-aadb-8974c8abcd56" (UID: "f4bfbe65-9191-4700-aadb-8974c8abcd56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:11.120907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.120821    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4bfbe65-9191-4700-aadb-8974c8abcd56-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.120907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.120851    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6xb7\" (UniqueName: \"kubernetes.io/projected/f4bfbe65-9191-4700-aadb-8974c8abcd56-kube-api-access-c6xb7\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.120907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.120863    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4bfbe65-9191-4700-aadb-8974c8abcd56-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:11.549144 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.549106    2558 generic.go:356] "Generic (PLEG): container finished" podID="f4bfbe65-9191-4700-aadb-8974c8abcd56" containerID="6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393" exitCode=0
Jul 27 19:29:11.549329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.549156    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"
Jul 27 19:29:11.549329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.549148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" event={"ID":"f4bfbe65-9191-4700-aadb-8974c8abcd56","Type":"ContainerDied","Data":"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"}
Jul 27 19:29:11.549329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.549276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44" event={"ID":"f4bfbe65-9191-4700-aadb-8974c8abcd56","Type":"ContainerDied","Data":"0f1fee0372c6d80077f8b8743af311e59cd88b62090730a8c1171600b52f3b08"}
Jul 27 19:29:11.549329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.549294    2558 scope.go:117] "RemoveContainer" containerID="6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"
Jul 27 19:29:11.558273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.558258    2558 scope.go:117] "RemoveContainer" containerID="6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"
Jul 27 19:29:11.558522 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:29:11.558506    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393\": container with ID starting with 6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393 not found: ID does not exist" containerID="6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"
Jul 27 19:29:11.558565 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.558530    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393"} err="failed to get container status \"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393\": rpc error: code = NotFound desc = could not find container \"6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393\": container with ID starting with 6cbc42e7768c9ab2693b0c1fe64583b9edade778df6a2e2ac2faf039c6756393 not found: ID does not exist"
Jul 27 19:29:11.573377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.573351    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:29:11.574954 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:11.574934    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-48d4dc3d-kserve-5d7c79999-mvq44"]
Jul 27 19:29:12.014006 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.013971    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" podUID="72e802de-3561-4101-86e0-60e1ebc31a9d" containerName="main" containerID="cri-o://197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93" gracePeriod=45
Jul 27 19:29:12.250206 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.250156    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4bfbe65-9191-4700-aadb-8974c8abcd56" path="/var/lib/kubelet/pods/f4bfbe65-9191-4700-aadb-8974c8abcd56/volumes"
Jul 27 19:29:12.270537 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.270483    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:29:12.432242 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432433 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432272    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432433 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432433 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432334    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432604 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432492    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6p4w\" (UniqueName: \"kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432604 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home\") pod \"72e802de-3561-4101-86e0-60e1ebc31a9d\" (UID: \"72e802de-3561-4101-86e0-60e1ebc31a9d\") "
Jul 27 19:29:12.432712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432491    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:12.432712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432580    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache" (OuterVolumeSpecName: "model-cache") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:12.432787 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432762    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home" (OuterVolumeSpecName: "home") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:12.433370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.432965    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.433370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.433140    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.433370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.433157    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.434616 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.434587    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm" (OuterVolumeSpecName: "dshm") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:29:12.434616 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.434594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:29:12.434733 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.434680    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w" (OuterVolumeSpecName: "kube-api-access-m6p4w") pod "72e802de-3561-4101-86e0-60e1ebc31a9d" (UID: "72e802de-3561-4101-86e0-60e1ebc31a9d"). InnerVolumeSpecName "kube-api-access-m6p4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:29:12.534530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.534466    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e802de-3561-4101-86e0-60e1ebc31a9d-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.534530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.534492    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e802de-3561-4101-86e0-60e1ebc31a9d-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.534530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.534501    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6p4w\" (UniqueName: \"kubernetes.io/projected/72e802de-3561-4101-86e0-60e1ebc31a9d-kube-api-access-m6p4w\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:29:12.554748 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.554716    2558 generic.go:356] "Generic (PLEG): container finished" podID="72e802de-3561-4101-86e0-60e1ebc31a9d" containerID="197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93" exitCode=0
Jul 27 19:29:12.554875 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.554767    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"
Jul 27 19:29:12.554875 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.554805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" event={"ID":"72e802de-3561-4101-86e0-60e1ebc31a9d","Type":"ContainerDied","Data":"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"}
Jul 27 19:29:12.554875 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.554846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch" event={"ID":"72e802de-3561-4101-86e0-60e1ebc31a9d","Type":"ContainerDied","Data":"360fa2496960082dc4da010e3bdbf4d9dcd60096b476e1dcd3b52497879d4894"}
Jul 27 19:29:12.554875 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.554865    2558 scope.go:117] "RemoveContainer" containerID="197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"
Jul 27 19:29:12.564040 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.564027    2558 scope.go:117] "RemoveContainer" containerID="197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"
Jul 27 19:29:12.564319 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:29:12.564297    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93\": container with ID starting with 197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93 not found: ID does not exist" containerID="197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"
Jul 27 19:29:12.564387 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.564327    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93"} err="failed to get container status \"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93\": rpc error: code = NotFound desc = could not find container \"197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93\": container with ID starting with 197cf0ddb118de48033e237140aa4c49255df8091f1f03ca33eabb37f4dacb93 not found: ID does not exist"
Jul 27 19:29:12.575943 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.575923    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:29:12.577491 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:12.577474    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-48d4dc3d-kserve-7977456779-lflch"]
Jul 27 19:29:14.249977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:29:14.249946    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72e802de-3561-4101-86e0-60e1ebc31a9d" path="/var/lib/kubelet/pods/72e802de-3561-4101-86e0-60e1ebc31a9d/volumes"
Jul 27 19:37:59.940390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.940355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:37:59.940970 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.940885    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72e802de-3561-4101-86e0-60e1ebc31a9d" containerName="main"
Jul 27 19:37:59.940970 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.940911    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="72e802de-3561-4101-86e0-60e1ebc31a9d" containerName="main"
Jul 27 19:37:59.940970 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.940945    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4bfbe65-9191-4700-aadb-8974c8abcd56" containerName="main"
Jul 27 19:37:59.940970 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.940954    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4bfbe65-9191-4700-aadb-8974c8abcd56" containerName="main"
Jul 27 19:37:59.941216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.941039    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="72e802de-3561-4101-86e0-60e1ebc31a9d" containerName="main"
Jul 27 19:37:59.941216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.941056    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4bfbe65-9191-4700-aadb-8974c8abcd56" containerName="main"
Jul 27 19:37:59.944211 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.944191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.944914 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.944892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.945013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.944923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkrp\" (UniqueName: \"kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.945013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.944945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.945188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.945145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.945254 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.945199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.945294 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.945253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:37:59.947300 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.947269    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-76809045\"/\"e2e-lifecycle-model-76809045-kserve-self-signed-certs\""
Jul 27 19:37:59.947392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.947278    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-76809045\"/\"kube-root-ca.crt\""
Jul 27 19:37:59.947392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.947316    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-76809045\"/\"openshift-service-ca.crt\""
Jul 27 19:37:59.947392 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:37:59.947325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-76809045\"/\"default-dockercfg-mq9s4\""
Jul 27 19:38:00.042136 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.042110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:38:00.045673 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.045734 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.045784 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.045784 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.045874 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkrp\" (UniqueName: \"kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.045874 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.045829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.046214 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.046188    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.046347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.046234    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.046347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.046275    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.048198 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.048155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.048342 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.048322    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.053854 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.053831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkrp\" (UniqueName: \"kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp\") pod \"e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") " pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.253944 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.253913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:00.385816 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.385791    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:38:00.388242 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:38:00.388216    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6412d6ee_8db0_440b_8149_65f9103c4e1b.slice/crio-58348ac506ebc414bf6098c6978dd173f4a6d94dad6ce5f86ca4f68410945d24 WatchSource:0}: Error finding container 58348ac506ebc414bf6098c6978dd173f4a6d94dad6ce5f86ca4f68410945d24: Status 404 returned error can't find the container with id 58348ac506ebc414bf6098c6978dd173f4a6d94dad6ce5f86ca4f68410945d24
Jul 27 19:38:00.889595 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.889560    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" event={"ID":"6412d6ee-8db0-440b-8149-65f9103c4e1b","Type":"ContainerStarted","Data":"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"}
Jul 27 19:38:00.889797 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.889609    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" event={"ID":"6412d6ee-8db0-440b-8149-65f9103c4e1b","Type":"ContainerStarted","Data":"58348ac506ebc414bf6098c6978dd173f4a6d94dad6ce5f86ca4f68410945d24"}
Jul 27 19:38:00.907801 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:00.907749    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" podStartSLOduration=1.907733122 podStartE2EDuration="1.907733122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:38:00.905122178 +0000 UTC m=+1963.101091266" watchObservedRunningTime="2026-07-27 19:38:00.907733122 +0000 UTC m=+1963.103702210"
Jul 27 19:38:10.254157 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:10.254085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:10.254157 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:10.254135    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:10.266578 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:10.266557    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:10.946808 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:10.946782    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:38:47.063430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:38:47.063394    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:39:02.083010 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.082964    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" podUID="6412d6ee-8db0-440b-8149-65f9103c4e1b" containerName="main" containerID="cri-o://049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776" gracePeriod=45
Jul 27 19:39:02.330040 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.330018    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:39:02.389959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.389869    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.389959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.389911    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.389959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.389940    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgkrp\" (UniqueName: \"kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.390252 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.389984    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.390252 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.390252 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390081    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache\") pod \"6412d6ee-8db0-440b-8149-65f9103c4e1b\" (UID: \"6412d6ee-8db0-440b-8149-65f9103c4e1b\") "
Jul 27 19:39:02.390252 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:02.390470 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390415    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:02.390523 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390476    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home" (OuterVolumeSpecName: "home") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:02.390523 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.390495    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:02.392387 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.392350    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp" (OuterVolumeSpecName: "kube-api-access-bgkrp") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "kube-api-access-bgkrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:39:02.392387 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.392378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:39:02.392523 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.392386    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm" (OuterVolumeSpecName: "dshm") pod "6412d6ee-8db0-440b-8149-65f9103c4e1b" (UID: "6412d6ee-8db0-440b-8149-65f9103c4e1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:39:02.491510 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.491482    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6412d6ee-8db0-440b-8149-65f9103c4e1b-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:02.491510 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.491506    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgkrp\" (UniqueName: \"kubernetes.io/projected/6412d6ee-8db0-440b-8149-65f9103c4e1b-kube-api-access-bgkrp\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:02.491510 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.491515    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:02.491723 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.491524    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:02.491723 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:02.491531    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6412d6ee-8db0-440b-8149-65f9103c4e1b-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:39:03.165531 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.165498    2558 generic.go:356] "Generic (PLEG): container finished" podID="6412d6ee-8db0-440b-8149-65f9103c4e1b" containerID="049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776" exitCode=0
Jul 27 19:39:03.165968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.165534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" event={"ID":"6412d6ee-8db0-440b-8149-65f9103c4e1b","Type":"ContainerDied","Data":"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"}
Jul 27 19:39:03.165968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.165573    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"
Jul 27 19:39:03.165968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.165587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg" event={"ID":"6412d6ee-8db0-440b-8149-65f9103c4e1b","Type":"ContainerDied","Data":"58348ac506ebc414bf6098c6978dd173f4a6d94dad6ce5f86ca4f68410945d24"}
Jul 27 19:39:03.165968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.165601    2558 scope.go:117] "RemoveContainer" containerID="049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"
Jul 27 19:39:03.174582 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.174566    2558 scope.go:117] "RemoveContainer" containerID="049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"
Jul 27 19:39:03.174825 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:39:03.174806    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776\": container with ID starting with 049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776 not found: ID does not exist" containerID="049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"
Jul 27 19:39:03.174881 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.174834    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776"} err="failed to get container status \"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776\": rpc error: code = NotFound desc = could not find container \"049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776\": container with ID starting with 049e75063d267f91b64911888a318dcc8103dbfcac7c87f899eafcf2e73ce776 not found: ID does not exist"
Jul 27 19:39:03.186908 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.186887    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:39:03.190498 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:03.190479    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-76809045/e2e-lifecycle-model-76809045-kserve-cf6d78c5f-hzhzg"]
Jul 27 19:39:04.249721 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:39:04.249689    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6412d6ee-8db0-440b-8149-65f9103c4e1b" path="/var/lib/kubelet/pods/6412d6ee-8db0-440b-8149-65f9103c4e1b/volumes"
Jul 27 19:40:59.656816 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.656781    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:40:59.657343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.657130    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6412d6ee-8db0-440b-8149-65f9103c4e1b" containerName="main"
Jul 27 19:40:59.657343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.657141    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6412d6ee-8db0-440b-8149-65f9103c4e1b" containerName="main"
Jul 27 19:40:59.657343 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.657213    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6412d6ee-8db0-440b-8149-65f9103c4e1b" containerName="main"
Jul 27 19:40:59.660138 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.660122    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.662705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.662673    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-35bf7c\"/\"kube-root-ca.crt\""
Jul 27 19:40:59.662882 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.662856    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-35bf7c\"/\"test-model-35bf7c-kserve-self-signed-certs\""
Jul 27 19:40:59.663647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.663629    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-35bf7c\"/\"openshift-service-ca.crt\""
Jul 27 19:40:59.663796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.663780    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-35bf7c\"/\"default-dockercfg-hgm5s\""
Jul 27 19:40:59.671347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.671327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:40:59.735885 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.735861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.736018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.735892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.736018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.735920    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.736018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.735981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.736130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.736026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.736130 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.736045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46qv\" (UniqueName: \"kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836561 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836751 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836751 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836751 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k46qv\" (UniqueName: \"kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836751 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.836994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.836954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.837109 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.837074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.837201 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.837117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.839221 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.839197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.839458 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.839438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.844153 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.844134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46qv\" (UniqueName: \"kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv\") pod \"test-model-35bf7c-kserve-896cfcf4f-g4k7q\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") " pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:40:59.969469 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:40:59.969366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:41:00.104524 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:00.104493    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:41:00.109539 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:41:00.109502    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4942cfbb_a9d1_473e_9137_67c69fc5411a.slice/crio-68bc354e50d28db41ba4b94a6c54d3734c77652f8fac331e0845b4121af4f13e WatchSource:0}: Error finding container 68bc354e50d28db41ba4b94a6c54d3734c77652f8fac331e0845b4121af4f13e: Status 404 returned error can't find the container with id 68bc354e50d28db41ba4b94a6c54d3734c77652f8fac331e0845b4121af4f13e
Jul 27 19:41:00.682089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:00.682057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" event={"ID":"4942cfbb-a9d1-473e-9137-67c69fc5411a","Type":"ContainerStarted","Data":"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"}
Jul 27 19:41:00.682089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:00.682095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" event={"ID":"4942cfbb-a9d1-473e-9137-67c69fc5411a","Type":"ContainerStarted","Data":"68bc354e50d28db41ba4b94a6c54d3734c77652f8fac331e0845b4121af4f13e"}
Jul 27 19:41:00.700247 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:00.700153    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" podStartSLOduration=1.700133935 podStartE2EDuration="1.700133935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:41:00.699370176 +0000 UTC m=+2142.895339265" watchObservedRunningTime="2026-07-27 19:41:00.700133935 +0000 UTC m=+2142.896103025"
Jul 27 19:41:09.970344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:09.970268    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:41:09.970344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:09.970308    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:41:09.982768 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:09.982740    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:41:10.740704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:10.740675    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:41:14.043414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.043381    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:41:14.047063 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.047044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.050188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.050139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d59e9c\"/\"default-dockercfg-28k87\""
Jul 27 19:41:14.050188 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.050139    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d59e9c\"/\"kube-root-ca.crt\""
Jul 27 19:41:14.050428 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.050140    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d59e9c\"/\"test-model-d59e9c-kserve-self-signed-certs\""
Jul 27 19:41:14.050428 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.050236    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d59e9c\"/\"openshift-service-ca.crt\""
Jul 27 19:41:14.056300 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.056279    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:41:14.160222 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.160381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.160381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.160381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ks8m\" (UniqueName: \"kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.160381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.160381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.160365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261239 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261465 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ks8m\" (UniqueName: \"kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261809 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261809 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.261929 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.261841    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.263616 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.263598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.263781 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.263766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.269930 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.269912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ks8m\" (UniqueName: \"kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m\") pod \"test-model-d59e9c-kserve-57f6b9b59f-5tw9d\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") " pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.358142 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.358071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:14.489873 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.489713    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:41:14.492513 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:41:14.492486    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09ba5d13_d609_415b_8dfb_128471124c45.slice/crio-c95fbc0c7a9be1da13f15827934cbe1c6b83e483010c17664e2111f331f6e55a WatchSource:0}: Error finding container c95fbc0c7a9be1da13f15827934cbe1c6b83e483010c17664e2111f331f6e55a: Status 404 returned error can't find the container with id c95fbc0c7a9be1da13f15827934cbe1c6b83e483010c17664e2111f331f6e55a
Jul 27 19:41:14.749049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.749019    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" event={"ID":"09ba5d13-d609-415b-8dfb-128471124c45","Type":"ContainerStarted","Data":"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"}
Jul 27 19:41:14.749228 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.749055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" event={"ID":"09ba5d13-d609-415b-8dfb-128471124c45","Type":"ContainerStarted","Data":"c95fbc0c7a9be1da13f15827934cbe1c6b83e483010c17664e2111f331f6e55a"}
Jul 27 19:41:14.765970 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:14.765927    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" podStartSLOduration=0.765911097 podStartE2EDuration="765.911097ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:41:14.763757889 +0000 UTC m=+2156.959726976" watchObservedRunningTime="2026-07-27 19:41:14.765911097 +0000 UTC m=+2156.961880185"
Jul 27 19:41:24.358996 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:24.358966    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:24.359462 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:24.359048    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:24.371526 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:24.371505    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:24.809981 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:24.809950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:41:54.723289 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:54.723259    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:41:55.644125 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:41:55.644093    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:42:09.742600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.742536    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" podUID="4942cfbb-a9d1-473e-9137-67c69fc5411a" containerName="main" containerID="cri-o://05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd" gracePeriod=45
Jul 27 19:42:09.993256 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.993196    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:42:09.998427 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.998399    2558 generic.go:356] "Generic (PLEG): container finished" podID="4942cfbb-a9d1-473e-9137-67c69fc5411a" containerID="05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd" exitCode=0
Jul 27 19:42:09.998551 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.998443    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"
Jul 27 19:42:09.998551 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.998486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" event={"ID":"4942cfbb-a9d1-473e-9137-67c69fc5411a","Type":"ContainerDied","Data":"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"}
Jul 27 19:42:09.998551 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.998539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q" event={"ID":"4942cfbb-a9d1-473e-9137-67c69fc5411a","Type":"ContainerDied","Data":"68bc354e50d28db41ba4b94a6c54d3734c77652f8fac331e0845b4121af4f13e"}
Jul 27 19:42:09.998660 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:09.998563    2558 scope.go:117] "RemoveContainer" containerID="05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"
Jul 27 19:42:10.008220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.008205    2558 scope.go:117] "RemoveContainer" containerID="05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"
Jul 27 19:42:10.008472 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:42:10.008456    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd\": container with ID starting with 05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd not found: ID does not exist" containerID="05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"
Jul 27 19:42:10.008530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.008483    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd"} err="failed to get container status \"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd\": rpc error: code = NotFound desc = could not find container \"05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd\": container with ID starting with 05d27d45c3ec6d0529eaa1cc61a81b196cf3703fb0a78dc81193187c5f5f2dbd not found: ID does not exist"
Jul 27 19:42:10.079964 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.079940    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080107 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.079973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k46qv\" (UniqueName: \"kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080107 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.079999    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080107 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080078    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080129    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache\") pod \"4942cfbb-a9d1-473e-9137-67c69fc5411a\" (UID: \"4942cfbb-a9d1-473e-9137-67c69fc5411a\") "
Jul 27 19:42:10.080405 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080382    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home" (OuterVolumeSpecName: "home") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.080459 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080396    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.080540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080523    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.080607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080565    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.080607 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.080558    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache" (OuterVolumeSpecName: "model-cache") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.082378 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.082349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm" (OuterVolumeSpecName: "dshm") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.082503 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.082385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:42:10.082579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.082500    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv" (OuterVolumeSpecName: "kube-api-access-k46qv") pod "4942cfbb-a9d1-473e-9137-67c69fc5411a" (UID: "4942cfbb-a9d1-473e-9137-67c69fc5411a"). InnerVolumeSpecName "kube-api-access-k46qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:10.181147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.181120    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.181147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.181142    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4942cfbb-a9d1-473e-9137-67c69fc5411a-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.181147 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.181153    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k46qv\" (UniqueName: \"kubernetes.io/projected/4942cfbb-a9d1-473e-9137-67c69fc5411a-kube-api-access-k46qv\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.181363 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.181161    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4942cfbb-a9d1-473e-9137-67c69fc5411a-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.314549 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.314518    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:42:10.317841 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.317817    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-35bf7c/test-model-35bf7c-kserve-896cfcf4f-g4k7q"]
Jul 27 19:42:10.663268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.663162    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" podUID="09ba5d13-d609-415b-8dfb-128471124c45" containerName="main" containerID="cri-o://31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17" gracePeriod=45
Jul 27 19:42:10.898087 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.898063    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:42:10.985430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985401    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985442    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985482    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ks8m\" (UniqueName: \"kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985539    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985564    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache\") pod \"09ba5d13-d609-415b-8dfb-128471124c45\" (UID: \"09ba5d13-d609-415b-8dfb-128471124c45\") "
Jul 27 19:42:10.985762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985690    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.985762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985703    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home" (OuterVolumeSpecName: "home") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.985925 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985903    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache" (OuterVolumeSpecName: "model-cache") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.985980 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985909    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.985980 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.985952    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:10.987924 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.987901    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:42:10.987924 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.987905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm" (OuterVolumeSpecName: "dshm") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:42:10.988076 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:10.987935    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m" (OuterVolumeSpecName: "kube-api-access-8ks8m") pod "09ba5d13-d609-415b-8dfb-128471124c45" (UID: "09ba5d13-d609-415b-8dfb-128471124c45"). InnerVolumeSpecName "kube-api-access-8ks8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:42:11.006023 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.005991    2558 generic.go:356] "Generic (PLEG): container finished" podID="09ba5d13-d609-415b-8dfb-128471124c45" containerID="31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17" exitCode=0
Jul 27 19:42:11.006195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.006036    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"
Jul 27 19:42:11.006195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.006071    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" event={"ID":"09ba5d13-d609-415b-8dfb-128471124c45","Type":"ContainerDied","Data":"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"}
Jul 27 19:42:11.006195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.006106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d" event={"ID":"09ba5d13-d609-415b-8dfb-128471124c45","Type":"ContainerDied","Data":"c95fbc0c7a9be1da13f15827934cbe1c6b83e483010c17664e2111f331f6e55a"}
Jul 27 19:42:11.006195 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.006127    2558 scope.go:117] "RemoveContainer" containerID="31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"
Jul 27 19:42:11.015049 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.015032    2558 scope.go:117] "RemoveContainer" containerID="31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"
Jul 27 19:42:11.015344 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:42:11.015326    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17\": container with ID starting with 31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17 not found: ID does not exist" containerID="31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"
Jul 27 19:42:11.015464 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.015352    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17"} err="failed to get container status \"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17\": rpc error: code = NotFound desc = could not find container \"31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17\": container with ID starting with 31fa6441c92674b832b5e03fe17b014dfa4146050202c955280642e72b6e7a17 not found: ID does not exist"
Jul 27 19:42:11.029727 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.029707    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:42:11.035285 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.035265    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d59e9c/test-model-d59e9c-kserve-57f6b9b59f-5tw9d"]
Jul 27 19:42:11.086802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.086778    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:11.086802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.086800    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09ba5d13-d609-415b-8dfb-128471124c45-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:11.086959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.086810    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09ba5d13-d609-415b-8dfb-128471124c45-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:11.086959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:11.086819    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ks8m\" (UniqueName: \"kubernetes.io/projected/09ba5d13-d609-415b-8dfb-128471124c45-kube-api-access-8ks8m\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:42:12.249370 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:12.249340    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ba5d13-d609-415b-8dfb-128471124c45" path="/var/lib/kubelet/pods/09ba5d13-d609-415b-8dfb-128471124c45/volumes"
Jul 27 19:42:12.249742 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:12.249709    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4942cfbb-a9d1-473e-9137-67c69fc5411a" path="/var/lib/kubelet/pods/4942cfbb-a9d1-473e-9137-67c69fc5411a/volumes"
Jul 27 19:42:43.041565 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041480    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041861    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4942cfbb-a9d1-473e-9137-67c69fc5411a" containerName="main"
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041875    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4942cfbb-a9d1-473e-9137-67c69fc5411a" containerName="main"
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041895    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ba5d13-d609-415b-8dfb-128471124c45" containerName="main"
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041901    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ba5d13-d609-415b-8dfb-128471124c45" containerName="main"
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041963    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ba5d13-d609-415b-8dfb-128471124c45" containerName="main"
Jul 27 19:42:43.042089 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.041973    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4942cfbb-a9d1-473e-9137-67c69fc5411a" containerName="main"
Jul 27 19:42:43.045020 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.044998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.047986 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.047964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-74909c-dockercfg-ksmmc\""
Jul 27 19:42:43.048097 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.047983    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-74909c\""
Jul 27 19:42:43.056320 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.056300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:42:43.083000 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.082967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.083213 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.083046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27sx\" (UniqueName: \"kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.183628 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.183595    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k27sx\" (UniqueName: \"kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.183797 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.183675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.184329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.184311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.193144 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.193116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27sx\" (UniqueName: \"kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx\") pod \"payload-processing-e2e-api-b-74909c-7585747598-wwdjh\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") " pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.358450 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.358359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:43.496807 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.496773    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:42:43.500765 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:42:43.500726    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361bb335_8026_404a_818f_c387639d1778.slice/crio-d215535caf8892829fd91bf53e2e6baebab84446616b1e1fad204c3f07166b74 WatchSource:0}: Error finding container d215535caf8892829fd91bf53e2e6baebab84446616b1e1fad204c3f07166b74: Status 404 returned error can't find the container with id d215535caf8892829fd91bf53e2e6baebab84446616b1e1fad204c3f07166b74
Jul 27 19:42:43.502726 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:43.502703    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:42:44.161251 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:44.161211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" event={"ID":"361bb335-8026-404a-818f-c387639d1778","Type":"ContainerStarted","Data":"d215535caf8892829fd91bf53e2e6baebab84446616b1e1fad204c3f07166b74"}
Jul 27 19:42:46.172935 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:46.172834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" event={"ID":"361bb335-8026-404a-818f-c387639d1778","Type":"ContainerStarted","Data":"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"}
Jul 27 19:42:46.173339 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:46.172960    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:42:46.189629 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:46.189582    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" podStartSLOduration=0.962181783 podStartE2EDuration="3.18954135s" totalImagesPullingTime="2.227359567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:42:46.188096301 +0000 UTC m=+2248.384065390" watchObservedRunningTime="2026-07-27 19:42:46.18954135 +0000 UTC m=+2248.385510437"
Jul 27 19:42:57.180331 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:42:57.180302    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:43:33.268211 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.268145    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:43:33.268744 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.268459    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" podUID="361bb335-8026-404a-818f-c387639d1778" containerName="payload-processing" containerID="cri-o://b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8" gracePeriod=30
Jul 27 19:43:33.526508 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.526457    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:43:33.636899 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.636871    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume\") pod \"361bb335-8026-404a-818f-c387639d1778\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") "
Jul 27 19:43:33.637051 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.636909    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k27sx\" (UniqueName: \"kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx\") pod \"361bb335-8026-404a-818f-c387639d1778\" (UID: \"361bb335-8026-404a-818f-c387639d1778\") "
Jul 27 19:43:33.637263 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.637238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "361bb335-8026-404a-818f-c387639d1778" (UID: "361bb335-8026-404a-818f-c387639d1778"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:43:33.639216 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.639199    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx" (OuterVolumeSpecName: "kube-api-access-k27sx") pod "361bb335-8026-404a-818f-c387639d1778" (UID: "361bb335-8026-404a-818f-c387639d1778"). InnerVolumeSpecName "kube-api-access-k27sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:43:33.737622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.737586    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361bb335-8026-404a-818f-c387639d1778-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:43:33.737622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:33.737616    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k27sx\" (UniqueName: \"kubernetes.io/projected/361bb335-8026-404a-818f-c387639d1778-kube-api-access-k27sx\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:43:34.383068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.383032    2558 generic.go:356] "Generic (PLEG): container finished" podID="361bb335-8026-404a-818f-c387639d1778" containerID="b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8" exitCode=0
Jul 27 19:43:34.383535 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.383079    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"
Jul 27 19:43:34.383535 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.383105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" event={"ID":"361bb335-8026-404a-818f-c387639d1778","Type":"ContainerDied","Data":"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"}
Jul 27 19:43:34.383535 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.383159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh" event={"ID":"361bb335-8026-404a-818f-c387639d1778","Type":"ContainerDied","Data":"d215535caf8892829fd91bf53e2e6baebab84446616b1e1fad204c3f07166b74"}
Jul 27 19:43:34.383535 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.383218    2558 scope.go:117] "RemoveContainer" containerID="b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"
Jul 27 19:43:34.391873 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.391859    2558 scope.go:117] "RemoveContainer" containerID="b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"
Jul 27 19:43:34.392132 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:43:34.392112    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8\": container with ID starting with b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8 not found: ID does not exist" containerID="b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"
Jul 27 19:43:34.392233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.392137    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8"} err="failed to get container status \"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8\": rpc error: code = NotFound desc = could not find container \"b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8\": container with ID starting with b27247ad79f91e171a158796d1736354518f0facb3e2e9f91df37f1cc29f4bd8 not found: ID does not exist"
Jul 27 19:43:34.413536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.413508    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:43:34.418114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:34.418095    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-74909c-7585747598-wwdjh"]
Jul 27 19:43:36.249951 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:36.249915    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361bb335-8026-404a-818f-c387639d1778" path="/var/lib/kubelet/pods/361bb335-8026-404a-818f-c387639d1778/volumes"
Jul 27 19:43:44.620220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.620182    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:43:44.620687 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.620552    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361bb335-8026-404a-818f-c387639d1778" containerName="payload-processing"
Jul 27 19:43:44.620687 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.620564    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="361bb335-8026-404a-818f-c387639d1778" containerName="payload-processing"
Jul 27 19:43:44.620687 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.620643    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="361bb335-8026-404a-818f-c387639d1778" containerName="payload-processing"
Jul 27 19:43:44.625050 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.625032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.627353 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.627316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-b4cd12-dockercfg-7mpcv\""
Jul 27 19:43:44.627353 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.627316    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-b4cd12\""
Jul 27 19:43:44.635333 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.635309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:43:44.642105 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.642084    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:43:44.645285 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.645270    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.657758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.657738    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:43:44.738563 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.738534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.738740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.738588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q86p\" (UniqueName: \"kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.738740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.738618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd96n\" (UniqueName: \"kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.738740 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.738662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.839679 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.839644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q86p\" (UniqueName: \"kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.839852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.839688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd96n\" (UniqueName: \"kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.839852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.839735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.839852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.839785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.840423 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.840406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.840508 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.840492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.847489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.847463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd96n\" (UniqueName: \"kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n\") pod \"payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") " pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:44.847684 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.847663    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q86p\" (UniqueName: \"kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p\") pod \"payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.936229 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.936127    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:44.955538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:44.955510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:45.085245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.085206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:43:45.089666 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:43:45.089637    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded742b51_35b1_4085_b15c_f5e7ed570cd4.slice/crio-59858ae8ec62fa23fcbbf06e7c6710434f87608b4055052bd1300bb8f6c97b1b WatchSource:0}: Error finding container 59858ae8ec62fa23fcbbf06e7c6710434f87608b4055052bd1300bb8f6c97b1b: Status 404 returned error can't find the container with id 59858ae8ec62fa23fcbbf06e7c6710434f87608b4055052bd1300bb8f6c97b1b
Jul 27 19:43:45.103615 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.103588    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:43:45.105602 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:43:45.105576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cf35ae_bb60_486d_82b1_595954bd5368.slice/crio-bd5b2c078253bbee19f6f5f5979c0c6573b37ebefc82f081901740ca7492431c WatchSource:0}: Error finding container bd5b2c078253bbee19f6f5f5979c0c6573b37ebefc82f081901740ca7492431c: Status 404 returned error can't find the container with id bd5b2c078253bbee19f6f5f5979c0c6573b37ebefc82f081901740ca7492431c
Jul 27 19:43:45.435705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.435667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" event={"ID":"ed742b51-35b1-4085-b15c-f5e7ed570cd4","Type":"ContainerStarted","Data":"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"}
Jul 27 19:43:45.435902 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.435732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" event={"ID":"ed742b51-35b1-4085-b15c-f5e7ed570cd4","Type":"ContainerStarted","Data":"59858ae8ec62fa23fcbbf06e7c6710434f87608b4055052bd1300bb8f6c97b1b"}
Jul 27 19:43:45.435902 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.435769    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:45.437123 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.437099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" event={"ID":"16cf35ae-bb60-486d-82b1-595954bd5368","Type":"ContainerStarted","Data":"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"}
Jul 27 19:43:45.437238 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.437145    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" event={"ID":"16cf35ae-bb60-486d-82b1-595954bd5368","Type":"ContainerStarted","Data":"bd5b2c078253bbee19f6f5f5979c0c6573b37ebefc82f081901740ca7492431c"}
Jul 27 19:43:45.437238 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.437232    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:43:45.452604 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.452567    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" podStartSLOduration=1.4525539379999999 podStartE2EDuration="1.452553938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:45.450102075 +0000 UTC m=+2307.646071162" watchObservedRunningTime="2026-07-27 19:43:45.452553938 +0000 UTC m=+2307.648523026"
Jul 27 19:43:45.468836 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:45.468800    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" podStartSLOduration=1.468787601 podStartE2EDuration="1.468787601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:45.467055989 +0000 UTC m=+2307.663025078" watchObservedRunningTime="2026-07-27 19:43:45.468787601 +0000 UTC m=+2307.664756689"
Jul 27 19:43:53.370391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.370355    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:43:53.373819 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.373805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.375861 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.375832    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-70aa40\""
Jul 27 19:43:53.375985 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.375897    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-70aa40-dockercfg-7gmp6\""
Jul 27 19:43:53.390538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.388916    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:43:53.516712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.516681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.516712 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.516714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425p6\" (UniqueName: \"kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.617576 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.617543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.617576 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.617580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425p6\" (UniqueName: \"kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.618291 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.618271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.625846 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.625778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425p6\" (UniqueName: \"kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6\") pod \"payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") " pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.684326 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.684302    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:53.818899 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:53.818862    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:43:53.822050 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:43:53.822023    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4590d62_2c02_4aaa_93a8_2bf62cbfceb5.slice/crio-bcedca1a90f94e79337a4230f277620edc847efff8a41d6c98e3a20ed81ca6dd WatchSource:0}: Error finding container bcedca1a90f94e79337a4230f277620edc847efff8a41d6c98e3a20ed81ca6dd: Status 404 returned error can't find the container with id bcedca1a90f94e79337a4230f277620edc847efff8a41d6c98e3a20ed81ca6dd
Jul 27 19:43:54.480434 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:54.480398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" event={"ID":"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5","Type":"ContainerStarted","Data":"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"}
Jul 27 19:43:54.480938 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:54.480459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" event={"ID":"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5","Type":"ContainerStarted","Data":"bcedca1a90f94e79337a4230f277620edc847efff8a41d6c98e3a20ed81ca6dd"}
Jul 27 19:43:54.480938 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:54.480546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:43:54.497458 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:54.497404    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" podStartSLOduration=1.4973882920000001 podStartE2EDuration="1.497388292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:43:54.496423144 +0000 UTC m=+2316.692392234" watchObservedRunningTime="2026-07-27 19:43:54.497388292 +0000 UTC m=+2316.693357411"
Jul 27 19:43:56.444344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:56.444315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:43:56.444789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:43:56.444379    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:44:05.487226 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:05.487192    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:44:10.145393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.145304    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:44:10.149513 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.149491    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.152691 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.152670    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"kube-root-ca.crt\""
Jul 27 19:44:10.152691 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.152687    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"auth-test-model-b4cd12-kserve-self-signed-certs\""
Jul 27 19:44:10.152891 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.152670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"default-dockercfg-5x47d\""
Jul 27 19:44:10.152891 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.152756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"openshift-service-ca.crt\""
Jul 27 19:44:10.159378 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.159359    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:44:10.269980 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.269944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.270201 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.269988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.270201 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.270031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.270201 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.270126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.270388 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.270244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9wnc\" (UniqueName: \"kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.270388 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.270281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371603 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371603 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371603 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9wnc\" (UniqueName: \"kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371603 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371833 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371894 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.371950 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.371899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.372033 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.372011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.373749 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.373729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.374025 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.374005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.379792 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.379767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9wnc\" (UniqueName: \"kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc\") pod \"auth-test-model-b4cd12-kserve-58cb9b668c-77bn6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") " pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.459279 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.459223    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:10.595902 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:10.595877    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:44:10.598159 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:44:10.598122    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa0688c7_b4c9_4341_869b_c213f1f51ea6.slice/crio-2d50c4517b19cd29263864496e2d58f09f83a6cc297ead3e7b047fa8bf13fcec WatchSource:0}: Error finding container 2d50c4517b19cd29263864496e2d58f09f83a6cc297ead3e7b047fa8bf13fcec: Status 404 returned error can't find the container with id 2d50c4517b19cd29263864496e2d58f09f83a6cc297ead3e7b047fa8bf13fcec
Jul 27 19:44:11.560688 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:11.560653    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" event={"ID":"aa0688c7-b4c9-4341-869b-c213f1f51ea6","Type":"ContainerStarted","Data":"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"}
Jul 27 19:44:11.560688 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:11.560695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" event={"ID":"aa0688c7-b4c9-4341-869b-c213f1f51ea6","Type":"ContainerStarted","Data":"2d50c4517b19cd29263864496e2d58f09f83a6cc297ead3e7b047fa8bf13fcec"}
Jul 27 19:44:11.579788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:11.579741    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" podStartSLOduration=1.5797223489999999 podStartE2EDuration="1.579722349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:44:11.579458794 +0000 UTC m=+2333.775427874" watchObservedRunningTime="2026-07-27 19:44:11.579722349 +0000 UTC m=+2333.775691438"
Jul 27 19:44:20.459802 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:20.459768    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:20.460276 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:20.459815    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:20.472240 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:20.472216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:20.615722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:20.615687    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:44:54.038362 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.038326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:44:54.042184 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.042144    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.044637 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.044616    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"openshift-service-ca.crt\""
Jul 27 19:44:54.044762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.044624    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"default-dockercfg-t74gx\""
Jul 27 19:44:54.045551 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.045531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"auth-test-model-70aa40-kserve-self-signed-certs\""
Jul 27 19:44:54.045639 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.045601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"kube-root-ca.crt\""
Jul 27 19:44:54.056407 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.056384    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:44:54.169962 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.169929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.170136 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.169993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.170136 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.170042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.170136 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.170055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.170136 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.170082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.170348 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.170155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsqrf\" (UniqueName: \"kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsqrf\" (UniqueName: \"kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.271977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.271927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.272040 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.272023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.273997 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.273978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.274180 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.274150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.279810 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.279788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsqrf\" (UniqueName: \"kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf\") pod \"auth-test-model-70aa40-kserve-7fd97866ff-6txw9\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") " pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.352875 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.352796    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:44:54.487639 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.487617    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:44:54.489689 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:44:54.489664    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3347b0c_e7d0_4559_a8e7_e4779a616f36.slice/crio-e72fde2ac18dd7911bfe4bf61b71229ce497ab1c184a393e55953bdcac7c6aa9 WatchSource:0}: Error finding container e72fde2ac18dd7911bfe4bf61b71229ce497ab1c184a393e55953bdcac7c6aa9: Status 404 returned error can't find the container with id e72fde2ac18dd7911bfe4bf61b71229ce497ab1c184a393e55953bdcac7c6aa9
Jul 27 19:44:54.770299 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.770265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" event={"ID":"b3347b0c-e7d0-4559-a8e7-e4779a616f36","Type":"ContainerStarted","Data":"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"}
Jul 27 19:44:54.770467 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.770309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" event={"ID":"b3347b0c-e7d0-4559-a8e7-e4779a616f36","Type":"ContainerStarted","Data":"e72fde2ac18dd7911bfe4bf61b71229ce497ab1c184a393e55953bdcac7c6aa9"}
Jul 27 19:44:54.790101 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:44:54.790051    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" podStartSLOduration=0.790034106 podStartE2EDuration="790.034106ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:44:54.788204966 +0000 UTC m=+2376.984174053" watchObservedRunningTime="2026-07-27 19:44:54.790034106 +0000 UTC m=+2376.986003231"
Jul 27 19:45:04.352989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:45:04.352956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:45:04.353376 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:45:04.353016    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:45:04.365281 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:45:04.365259    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:45:04.831546 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:45:04.831520    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:49:46.906396 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:49:46.906361    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:49:47.761233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:49:47.761200    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:50:01.926952 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:01.926903    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" podUID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" containerName="main" containerID="cri-o://a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398" gracePeriod=45
Jul 27 19:50:02.184493 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.184427    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:50:02.197935 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.197907    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.197955    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.197980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9wnc\" (UniqueName: \"kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.197999    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198033    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198118    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache\") pod \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\" (UID: \"aa0688c7-b4c9-4341-869b-c213f1f51ea6\") "
Jul 27 19:50:02.198367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198281    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:02.198367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198343    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home" (OuterVolumeSpecName: "home") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:02.198531 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198490    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.198531 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache" (OuterVolumeSpecName: "model-cache") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:02.198653 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.198534    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.203655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.202293    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:50:02.203655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.202812    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm" (OuterVolumeSpecName: "dshm") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:02.203655 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.203610    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc" (OuterVolumeSpecName: "kube-api-access-w9wnc") pod "aa0688c7-b4c9-4341-869b-c213f1f51ea6" (UID: "aa0688c7-b4c9-4341-869b-c213f1f51ea6"). InnerVolumeSpecName "kube-api-access-w9wnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:50:02.223677 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.223643    2558 generic.go:356] "Generic (PLEG): container finished" podID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" containerID="a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398" exitCode=0
Jul 27 19:50:02.223838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.223684    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"
Jul 27 19:50:02.223838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.223707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" event={"ID":"aa0688c7-b4c9-4341-869b-c213f1f51ea6","Type":"ContainerDied","Data":"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"}
Jul 27 19:50:02.223838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.223743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6" event={"ID":"aa0688c7-b4c9-4341-869b-c213f1f51ea6","Type":"ContainerDied","Data":"2d50c4517b19cd29263864496e2d58f09f83a6cc297ead3e7b047fa8bf13fcec"}
Jul 27 19:50:02.223838 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.223760    2558 scope.go:117] "RemoveContainer" containerID="a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"
Jul 27 19:50:02.233359 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.233340    2558 scope.go:117] "RemoveContainer" containerID="a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"
Jul 27 19:50:02.233629 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:50:02.233608    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398\": container with ID starting with a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398 not found: ID does not exist" containerID="a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"
Jul 27 19:50:02.233718 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.233636    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398"} err="failed to get container status \"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398\": rpc error: code = NotFound desc = could not find container \"a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398\": container with ID starting with a8b26c4eba1fa70800836c9396ec92fd0d60794b2efcbf15f70aa35bf9529398 not found: ID does not exist"
Jul 27 19:50:02.250893 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.250867    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:50:02.251437 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.251419    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/auth-test-model-b4cd12-kserve-58cb9b668c-77bn6"]
Jul 27 19:50:02.299439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.299402    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.299439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.299437    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa0688c7-b4c9-4341-869b-c213f1f51ea6-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.299660 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.299451    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa0688c7-b4c9-4341-869b-c213f1f51ea6-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.299660 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.299464    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9wnc\" (UniqueName: \"kubernetes.io/projected/aa0688c7-b4c9-4341-869b-c213f1f51ea6-kube-api-access-w9wnc\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:02.781266 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:02.781228    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" podUID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" containerName="main" containerID="cri-o://6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334" gracePeriod=45
Jul 27 19:50:03.036578 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.036523    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:50:03.108326 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108345    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108387    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsqrf\" (UniqueName: \"kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108745 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache\") pod \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\" (UID: \"b3347b0c-e7d0-4559-a8e7-e4779a616f36\") "
Jul 27 19:50:03.108745 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108664    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home" (OuterVolumeSpecName: "home") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:03.108745 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:03.108919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108879    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.108919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108879    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:03.108919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.108898    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.110890 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.110850    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm" (OuterVolumeSpecName: "dshm") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:50:03.111056 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.110969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:50:03.111056 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.110970    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf" (OuterVolumeSpecName: "kube-api-access-xsqrf") pod "b3347b0c-e7d0-4559-a8e7-e4779a616f36" (UID: "b3347b0c-e7d0-4559-a8e7-e4779a616f36"). InnerVolumeSpecName "kube-api-access-xsqrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:50:03.210346 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.210313    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3347b0c-e7d0-4559-a8e7-e4779a616f36-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.210346 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.210342    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsqrf\" (UniqueName: \"kubernetes.io/projected/b3347b0c-e7d0-4559-a8e7-e4779a616f36-kube-api-access-xsqrf\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.210346 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.210351    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.210565 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.210360    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3347b0c-e7d0-4559-a8e7-e4779a616f36-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:50:03.229877 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.229845    2558 generic.go:356] "Generic (PLEG): container finished" podID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" containerID="6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334" exitCode=0
Jul 27 19:50:03.230018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.229883    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"
Jul 27 19:50:03.230018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.229936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" event={"ID":"b3347b0c-e7d0-4559-a8e7-e4779a616f36","Type":"ContainerDied","Data":"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"}
Jul 27 19:50:03.230018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.229978    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9" event={"ID":"b3347b0c-e7d0-4559-a8e7-e4779a616f36","Type":"ContainerDied","Data":"e72fde2ac18dd7911bfe4bf61b71229ce497ab1c184a393e55953bdcac7c6aa9"}
Jul 27 19:50:03.230018 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.229995    2558 scope.go:117] "RemoveContainer" containerID="6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"
Jul 27 19:50:03.239851 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.239834    2558 scope.go:117] "RemoveContainer" containerID="6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"
Jul 27 19:50:03.240094 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:50:03.240078    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334\": container with ID starting with 6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334 not found: ID does not exist" containerID="6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"
Jul 27 19:50:03.240141 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.240101    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334"} err="failed to get container status \"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334\": rpc error: code = NotFound desc = could not find container \"6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334\": container with ID starting with 6121f3f11a907110a75064a8c1f1922e66efda6a954d6a1b899a9e5edbe33334 not found: ID does not exist"
Jul 27 19:50:03.253761 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.253739    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:50:03.257269 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:03.257248    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/auth-test-model-70aa40-kserve-7fd97866ff-6txw9"]
Jul 27 19:50:04.249218 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:04.249191    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" path="/var/lib/kubelet/pods/aa0688c7-b4c9-4341-869b-c213f1f51ea6/volumes"
Jul 27 19:50:04.249613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:04.249573    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" path="/var/lib/kubelet/pods/b3347b0c-e7d0-4559-a8e7-e4779a616f36/volumes"
Jul 27 19:50:21.340041 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340009    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:50:21.340461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340411    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" containerName="main"
Jul 27 19:50:21.340461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340424    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" containerName="main"
Jul 27 19:50:21.340461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340433    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" containerName="main"
Jul 27 19:50:21.340461 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340438    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" containerName="main"
Jul 27 19:50:21.340613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340508    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0688c7-b4c9-4341-869b-c213f1f51ea6" containerName="main"
Jul 27 19:50:21.340613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.340517    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3347b0c-e7d0-4559-a8e7-e4779a616f36" containerName="main"
Jul 27 19:50:21.344988 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.344970    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.347945 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.347921    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"kube-root-ca.crt\""
Jul 27 19:50:21.348083 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.347975    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"openshift-service-ca.crt\""
Jul 27 19:50:21.348083 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.347923    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"sub-test-model-70aa40-kserve-self-signed-certs\""
Jul 27 19:50:21.348083 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.348063    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"default-dockercfg-t74gx\""
Jul 27 19:50:21.354332 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.354313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:50:21.469530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.469704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bpkr\" (UniqueName: \"kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.469704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.469704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.469704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469684    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.469937 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.469717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.570867 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.570828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571045 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.570885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571045 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.570920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571045 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.570947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571045 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.570976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571284 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.571102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bpkr\" (UniqueName: \"kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.571435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571557 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.571473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.571557 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.571496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.573331 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.573309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.573437 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.573419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.579884 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.579864    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bpkr\" (UniqueName: \"kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr\") pod \"sub-test-model-70aa40-kserve-54749989b9-r6hpr\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") " pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.654600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.654526    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:21.787538 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:21.787507    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:50:21.790076 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:50:21.790049    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8cbd0de_a683_467f_9957_3da0ced7c94d.slice/crio-54013a26f27ce1700ab0c98364719a7093eeb3e75515535eca3329732e17fe41 WatchSource:0}: Error finding container 54013a26f27ce1700ab0c98364719a7093eeb3e75515535eca3329732e17fe41: Status 404 returned error can't find the container with id 54013a26f27ce1700ab0c98364719a7093eeb3e75515535eca3329732e17fe41
Jul 27 19:50:22.315915 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:22.315880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" event={"ID":"b8cbd0de-a683-467f-9957-3da0ced7c94d","Type":"ContainerStarted","Data":"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"}
Jul 27 19:50:22.315915 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:22.315922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" event={"ID":"b8cbd0de-a683-467f-9957-3da0ced7c94d","Type":"ContainerStarted","Data":"54013a26f27ce1700ab0c98364719a7093eeb3e75515535eca3329732e17fe41"}
Jul 27 19:50:22.335068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:22.335018    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" podStartSLOduration=1.335002853 podStartE2EDuration="1.335002853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:50:22.333141324 +0000 UTC m=+2704.529110415" watchObservedRunningTime="2026-07-27 19:50:22.335002853 +0000 UTC m=+2704.530971981"
Jul 27 19:50:31.655521 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:31.655485    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:31.655994 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:31.655547    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:31.670478 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:31.670453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:50:32.371722 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:50:32.371684    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:51:40.066693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:40.066616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:51:48.458885 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.458856    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:51:48.462424 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.462408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.465004 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.464979    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"default-dockercfg-5x47d\""
Jul 27 19:51:48.465675 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.465653    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"kube-root-ca.crt\""
Jul 27 19:51:48.465896 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.465876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"rate-test-model-b4cd12-kserve-self-signed-certs\""
Jul 27 19:51:48.466059 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.466047    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b4cd12\"/\"openshift-service-ca.crt\""
Jul 27 19:51:48.472007 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.471984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:51:48.564425 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.564581 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.564581 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwgk\" (UniqueName: \"kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.564581 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.564691 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.564691 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.564633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665473 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665441    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665600    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwgk\" (UniqueName: \"kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665949 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.665984 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.665963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.667982 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.667958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.668143 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.668128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.674181 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.674151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwgk\" (UniqueName: \"kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk\") pod \"rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") " pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.772378 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.772342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:48.908544 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:48.908516    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:51:48.912221 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:51:48.912195    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cf3c722_7813_45a1_9b99_4bdfaff1fcd6.slice/crio-cff0ce2c5d98b830230164e27c79ffd72d836acfeaffd23c08ed813f39108c9d WatchSource:0}: Error finding container cff0ce2c5d98b830230164e27c79ffd72d836acfeaffd23c08ed813f39108c9d: Status 404 returned error can't find the container with id cff0ce2c5d98b830230164e27c79ffd72d836acfeaffd23c08ed813f39108c9d
Jul 27 19:51:49.714809 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:49.714763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" event={"ID":"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6","Type":"ContainerStarted","Data":"b6f956010e12eb55b579bf88fba4704b3d12ffe5bcb0d8e587f93dc5ed5d5ce5"}
Jul 27 19:51:49.714809 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:49.714815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" event={"ID":"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6","Type":"ContainerStarted","Data":"cff0ce2c5d98b830230164e27c79ffd72d836acfeaffd23c08ed813f39108c9d"}
Jul 27 19:51:49.731276 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:49.731224    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" podStartSLOduration=1.731207417 podStartE2EDuration="1.731207417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:51:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:51:49.73019468 +0000 UTC m=+2791.926163758" watchObservedRunningTime="2026-07-27 19:51:49.731207417 +0000 UTC m=+2791.927176506"
Jul 27 19:51:55.086131 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.086093    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" podUID="b8cbd0de-a683-467f-9957-3da0ced7c94d" containerName="main" containerID="cri-o://6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189" gracePeriod=45
Jul 27 19:51:55.340264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.340207    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:51:55.430517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430485    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bpkr\" (UniqueName: \"kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430517 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430525    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430769 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430561    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430769 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430585    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430769 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430644    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430769 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs\") pod \"b8cbd0de-a683-467f-9957-3da0ced7c94d\" (UID: \"b8cbd0de-a683-467f-9957-3da0ced7c94d\") "
Jul 27 19:51:55.430989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:55.430989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430839    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home" (OuterVolumeSpecName: "home") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:55.430989 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.430955    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:55.432911 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.432886    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm" (OuterVolumeSpecName: "dshm") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:51:55.432911 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.432891    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr" (OuterVolumeSpecName: "kube-api-access-7bpkr") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "kube-api-access-7bpkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:51:55.433068 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.432972    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8cbd0de-a683-467f-9957-3da0ced7c94d" (UID: "b8cbd0de-a683-467f-9957-3da0ced7c94d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:51:55.531315 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531284    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8cbd0de-a683-467f-9957-3da0ced7c94d-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.531315 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531310    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bpkr\" (UniqueName: \"kubernetes.io/projected/b8cbd0de-a683-467f-9957-3da0ced7c94d-kube-api-access-7bpkr\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.531315 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531320    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.531541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531328    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.531541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531336    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.531541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.531343    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8cbd0de-a683-467f-9957-3da0ced7c94d-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:51:55.742354 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.742319    2558 generic.go:356] "Generic (PLEG): container finished" podID="b8cbd0de-a683-467f-9957-3da0ced7c94d" containerID="6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189" exitCode=0
Jul 27 19:51:55.742524 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.742363    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"
Jul 27 19:51:55.742524 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.742415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" event={"ID":"b8cbd0de-a683-467f-9957-3da0ced7c94d","Type":"ContainerDied","Data":"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"}
Jul 27 19:51:55.742524 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.742457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr" event={"ID":"b8cbd0de-a683-467f-9957-3da0ced7c94d","Type":"ContainerDied","Data":"54013a26f27ce1700ab0c98364719a7093eeb3e75515535eca3329732e17fe41"}
Jul 27 19:51:55.742524 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.742477    2558 scope.go:117] "RemoveContainer" containerID="6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"
Jul 27 19:51:55.752659 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.752634    2558 scope.go:117] "RemoveContainer" containerID="6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"
Jul 27 19:51:55.753031 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:51:55.752991    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189\": container with ID starting with 6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189 not found: ID does not exist" containerID="6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"
Jul 27 19:51:55.753122 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.753044    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189"} err="failed to get container status \"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189\": rpc error: code = NotFound desc = could not find container \"6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189\": container with ID starting with 6df48a81430982c879e5ddd5ce83f715132a33ed013e3400edb69b3d72da6189 not found: ID does not exist"
Jul 27 19:51:55.768644 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.768619    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:51:55.772577 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:55.772557    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/sub-test-model-70aa40-kserve-54749989b9-r6hpr"]
Jul 27 19:51:56.249555 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:56.249523    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8cbd0de-a683-467f-9957-3da0ced7c94d" path="/var/lib/kubelet/pods/b8cbd0de-a683-467f-9957-3da0ced7c94d/volumes"
Jul 27 19:51:58.772705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:58.772675    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:58.772705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:58.772711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:58.785448 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:58.785428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:51:59.771898 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:51:59.771870    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:52:29.648748 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.648716    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:52:29.649146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.649114    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8cbd0de-a683-467f-9957-3da0ced7c94d" containerName="main"
Jul 27 19:52:29.649146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.649130    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8cbd0de-a683-467f-9957-3da0ced7c94d" containerName="main"
Jul 27 19:52:29.649268 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.649252    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8cbd0de-a683-467f-9957-3da0ced7c94d" containerName="main"
Jul 27 19:52:29.652328 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.652308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.657113 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.657090    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"default-dockercfg-t74gx\""
Jul 27 19:52:29.657377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.657361    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"kube-root-ca.crt\""
Jul 27 19:52:29.657463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.657389    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"rate-test-model-70aa40-kserve-self-signed-certs\""
Jul 27 19:52:29.657463 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.657393    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70aa40\"/\"openshift-service-ca.crt\""
Jul 27 19:52:29.664262 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.664241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:52:29.737307 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.737307 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svfsg\" (UniqueName: \"kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.737519 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.737558 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.737600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.737635 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.737614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.838945 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.838908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.838945 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.838946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839141 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.838967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839141 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svfsg\" (UniqueName: \"kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839245 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839141    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839452 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839579 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.839694 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.839675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.841401 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.841382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.841632 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.841617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.847393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.847369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svfsg\" (UniqueName: \"kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg\") pod \"rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") " pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:29.962674 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:29.962585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:30.097078 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:30.097056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:52:30.099307 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:52:30.099279    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff4ad78_e5c0_4eac_ba8b_7d941381f888.slice/crio-9ac37275644b57c3a3602155150dacf2e6f36167ab579c33c31f7d35ef655967 WatchSource:0}: Error finding container 9ac37275644b57c3a3602155150dacf2e6f36167ab579c33c31f7d35ef655967: Status 404 returned error can't find the container with id 9ac37275644b57c3a3602155150dacf2e6f36167ab579c33c31f7d35ef655967
Jul 27 19:52:30.905426 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:30.905390    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" event={"ID":"6ff4ad78-e5c0-4eac-ba8b-7d941381f888","Type":"ContainerStarted","Data":"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"}
Jul 27 19:52:30.905426 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:30.905432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" event={"ID":"6ff4ad78-e5c0-4eac-ba8b-7d941381f888","Type":"ContainerStarted","Data":"9ac37275644b57c3a3602155150dacf2e6f36167ab579c33c31f7d35ef655967"}
Jul 27 19:52:30.922639 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:30.922587    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" podStartSLOduration=1.9225717979999999 podStartE2EDuration="1.922571798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:52:30.920225696 +0000 UTC m=+2833.116194791" watchObservedRunningTime="2026-07-27 19:52:30.922571798 +0000 UTC m=+2833.118540933"
Jul 27 19:52:39.963566 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:39.963530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:39.964001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:39.963590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:39.976430 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:39.976405    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:52:40.960919 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:52:40.960889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:53:37.031365 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:37.031330    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:53:37.839143 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:37.839115    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:53:52.050968 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.050908    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" podUID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" containerName="main" containerID="cri-o://b6f956010e12eb55b579bf88fba4704b3d12ffe5bcb0d8e587f93dc5ed5d5ce5" gracePeriod=45
Jul 27 19:53:52.290520 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.290491    2558 generic.go:356] "Generic (PLEG): container finished" podID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" containerID="b6f956010e12eb55b579bf88fba4704b3d12ffe5bcb0d8e587f93dc5ed5d5ce5" exitCode=0
Jul 27 19:53:52.290646 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.290539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" event={"ID":"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6","Type":"ContainerDied","Data":"b6f956010e12eb55b579bf88fba4704b3d12ffe5bcb0d8e587f93dc5ed5d5ce5"}
Jul 27 19:53:52.306762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.306707    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:53:52.401568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401535    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smwgk\" (UniqueName: \"kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401683    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401705    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401747 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401736    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401774    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm\") pod \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\" (UID: \"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6\") "
Jul 27 19:53:52.401977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache" (OuterVolumeSpecName: "model-cache") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:52.401977 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401964    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:52.402124 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.401973    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home" (OuterVolumeSpecName: "home") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:52.402445 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.402376    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.402445 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.402400    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.402445 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.402409    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.403926 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.403900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm" (OuterVolumeSpecName: "dshm") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:52.404025 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.403990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:53:52.404210 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.404189    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk" (OuterVolumeSpecName: "kube-api-access-smwgk") pod "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" (UID: "7cf3c722-7813-45a1-9b99-4bdfaff1fcd6"). InnerVolumeSpecName "kube-api-access-smwgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:52.502817 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.502791    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.502817 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.502813    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.502976 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.502822    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smwgk\" (UniqueName: \"kubernetes.io/projected/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6-kube-api-access-smwgk\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:52.858614 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:52.858559    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" podUID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" containerName="main" containerID="cri-o://c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4" gracePeriod=45
Jul 27 19:53:53.121481 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.121408    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:53:53.207998 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.207973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208215 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208010    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208215 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208039    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208215 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svfsg\" (UniqueName: \"kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208215 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm\") pod \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\" (UID: \"6ff4ad78-e5c0-4eac-ba8b-7d941381f888\") "
Jul 27 19:53:53.208439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208310    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home" (OuterVolumeSpecName: "home") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:53.208439 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208362    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:53.208600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208431    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:53.208600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208578    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.208600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208593    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.208751 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.208608    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.210372 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.210345    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm" (OuterVolumeSpecName: "dshm") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:53:53.210472 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.210413    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:53:53.210472 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.210458    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg" (OuterVolumeSpecName: "kube-api-access-svfsg") pod "6ff4ad78-e5c0-4eac-ba8b-7d941381f888" (UID: "6ff4ad78-e5c0-4eac-ba8b-7d941381f888"). InnerVolumeSpecName "kube-api-access-svfsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:53.296611 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.296578    2558 generic.go:356] "Generic (PLEG): container finished" podID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" containerID="c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4" exitCode=0
Jul 27 19:53:53.296746 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.296623    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"
Jul 27 19:53:53.296746 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.296660    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" event={"ID":"6ff4ad78-e5c0-4eac-ba8b-7d941381f888","Type":"ContainerDied","Data":"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"}
Jul 27 19:53:53.296746 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.296699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg" event={"ID":"6ff4ad78-e5c0-4eac-ba8b-7d941381f888","Type":"ContainerDied","Data":"9ac37275644b57c3a3602155150dacf2e6f36167ab579c33c31f7d35ef655967"}
Jul 27 19:53:53.296746 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.296718    2558 scope.go:117] "RemoveContainer" containerID="c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"
Jul 27 19:53:53.298098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.298059    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"
Jul 27 19:53:53.298098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.298084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x" event={"ID":"7cf3c722-7813-45a1-9b99-4bdfaff1fcd6","Type":"ContainerDied","Data":"cff0ce2c5d98b830230164e27c79ffd72d836acfeaffd23c08ed813f39108c9d"}
Jul 27 19:53:53.306319 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.306293    2558 scope.go:117] "RemoveContainer" containerID="c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"
Jul 27 19:53:53.306652 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:53:53.306627    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4\": container with ID starting with c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4 not found: ID does not exist" containerID="c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"
Jul 27 19:53:53.306772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.306664    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4"} err="failed to get container status \"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4\": rpc error: code = NotFound desc = could not find container \"c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4\": container with ID starting with c74b39ea62cd6a85edcbd267b8f76abc633b5b8fc02772f6d4de9e84135631e4 not found: ID does not exist"
Jul 27 19:53:53.306772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.306689    2558 scope.go:117] "RemoveContainer" containerID="b6f956010e12eb55b579bf88fba4704b3d12ffe5bcb0d8e587f93dc5ed5d5ce5"
Jul 27 19:53:53.309209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.309158    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.309209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.309204    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.309361 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.309218    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svfsg\" (UniqueName: \"kubernetes.io/projected/6ff4ad78-e5c0-4eac-ba8b-7d941381f888-kube-api-access-svfsg\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:53.323903 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.323883    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:53:53.327399 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.327373    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70aa40/rate-test-model-70aa40-kserve-77f6fcbccf-cs6hg"]
Jul 27 19:53:53.336658 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.336640    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:53:53.342779 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.342762    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b4cd12/rate-test-model-b4cd12-kserve-7d7fc5cf5-rmq4x"]
Jul 27 19:53:53.850036 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:53.850383 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850370    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" containerName="main"
Jul 27 19:53:53.850442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850385    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" containerName="main"
Jul 27 19:53:53.850442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850407    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" containerName="main"
Jul 27 19:53:53.850442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850412    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" containerName="main"
Jul 27 19:53:53.850534 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850467    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" containerName="main"
Jul 27 19:53:53.850534 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.850478    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" containerName="main"
Jul 27 19:53:53.854739 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.854724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:53.857290 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.857267    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8p9gv\""
Jul 27 19:53:53.859509 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.859489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:53.915009 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:53.914974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mlr\" (UniqueName: \"kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr\") pod \"test-curl-7705-140660635170400\" (UID: \"6ea6ccb3-44d3-491b-ae79-38ab86485333\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:54.016582 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.016548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mlr\" (UniqueName: \"kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr\") pod \"test-curl-7705-140660635170400\" (UID: \"6ea6ccb3-44d3-491b-ae79-38ab86485333\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:54.024643 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.024624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mlr\" (UniqueName: \"kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr\") pod \"test-curl-7705-140660635170400\" (UID: \"6ea6ccb3-44d3-491b-ae79-38ab86485333\") " pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:54.165220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.165124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:54.250329 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.250302    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff4ad78-e5c0-4eac-ba8b-7d941381f888" path="/var/lib/kubelet/pods/6ff4ad78-e5c0-4eac-ba8b-7d941381f888/volumes"
Jul 27 19:53:54.250736 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.250723    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cf3c722-7813-45a1-9b99-4bdfaff1fcd6" path="/var/lib/kubelet/pods/7cf3c722-7813-45a1-9b99-4bdfaff1fcd6/volumes"
Jul 27 19:53:54.306511 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.306357    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:54.309052 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:53:54.309027    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ea6ccb3_44d3_491b_ae79_38ab86485333.slice/crio-100825e76c28b598b8e5c326beb27d3263cbbceb277872b3ec81d0027c715313 WatchSource:0}: Error finding container 100825e76c28b598b8e5c326beb27d3263cbbceb277872b3ec81d0027c715313: Status 404 returned error can't find the container with id 100825e76c28b598b8e5c326beb27d3263cbbceb277872b3ec81d0027c715313
Jul 27 19:53:54.310264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:54.310241    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:53:55.314043 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:55.313958    2558 generic.go:356] "Generic (PLEG): container finished" podID="6ea6ccb3-44d3-491b-ae79-38ab86485333" containerID="b36483af331834ca55a077aff8ce4b1335fcf0775f3ab71232a436f23d2c6529" exitCode=0
Jul 27 19:53:55.314412 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:55.314042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660635170400" event={"ID":"6ea6ccb3-44d3-491b-ae79-38ab86485333","Type":"ContainerDied","Data":"b36483af331834ca55a077aff8ce4b1335fcf0775f3ab71232a436f23d2c6529"}
Jul 27 19:53:55.314412 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:55.314086    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7705-140660635170400" event={"ID":"6ea6ccb3-44d3-491b-ae79-38ab86485333","Type":"ContainerStarted","Data":"100825e76c28b598b8e5c326beb27d3263cbbceb277872b3ec81d0027c715313"}
Jul 27 19:53:56.456756 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.456731    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:56.492593 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.492570    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7705-140660635170400_6ea6ccb3-44d3-491b-ae79-38ab86485333/test-curl-7705-140660635170400/0.log"
Jul 27 19:53:56.519272 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.519245    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:56.522983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.522960    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7705-140660635170400"]
Jul 27 19:53:56.537283 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.537265    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8mlr\" (UniqueName: \"kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr\") pod \"6ea6ccb3-44d3-491b-ae79-38ab86485333\" (UID: \"6ea6ccb3-44d3-491b-ae79-38ab86485333\") "
Jul 27 19:53:56.539387 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.539365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr" (OuterVolumeSpecName: "kube-api-access-x8mlr") pod "6ea6ccb3-44d3-491b-ae79-38ab86485333" (UID: "6ea6ccb3-44d3-491b-ae79-38ab86485333"). InnerVolumeSpecName "kube-api-access-x8mlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:53:56.638841 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:56.638772    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8mlr\" (UniqueName: \"kubernetes.io/projected/6ea6ccb3-44d3-491b-ae79-38ab86485333-kube-api-access-x8mlr\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:53:57.329887 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:57.329852    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:57.330087 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:57.329897    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="100825e76c28b598b8e5c326beb27d3263cbbceb277872b3ec81d0027c715313"
Jul 27 19:53:57.341156 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:53:57.341122    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7705-140660635170400\" is forbidden: User \"system:node:ip-10-0-132-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-61.ec2.internal' and this object" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:58.248954 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:53:58.248918    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7705-140660635170400\" is forbidden: User \"system:node:ip-10-0-132-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-61.ec2.internal' and this object" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" pod="opendatahub/test-curl-7705-140660635170400"
Jul 27 19:53:58.250962 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:53:58.250940    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" path="/var/lib/kubelet/pods/6ea6ccb3-44d3-491b-ae79-38ab86485333/volumes"
Jul 27 19:54:01.483683 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.483650    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:54:01.484064 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.484050    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" containerName="test-curl-7705-140660635170400"
Jul 27 19:54:01.484114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.484066    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" containerName="test-curl-7705-140660635170400"
Jul 27 19:54:01.484151 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.484127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea6ccb3-44d3-491b-ae79-38ab86485333" containerName="test-curl-7705-140660635170400"
Jul 27 19:54:01.487340 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.487320    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.489847 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.489828    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-f227a8\""
Jul 27 19:54:01.497912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.497893    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:54:01.526146 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.526118    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:54:01.529649 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.529623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.532202 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.532182    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-f227a8-dockercfg-q6bzc\""
Jul 27 19:54:01.542500 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.542474    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:54:01.582930 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.582898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whp9d\" (UniqueName: \"kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.582930 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.582930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glsnn\" (UniqueName: \"kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.583115 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.583001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.583115 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.583039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.684375 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.684339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.684555 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.684387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.684555 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.684485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whp9d\" (UniqueName: \"kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.684555 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.684518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glsnn\" (UniqueName: \"kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.685079 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.685057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.685305 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.685286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.694107 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.694079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glsnn\" (UniqueName: \"kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn\") pod \"payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.694233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.694201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whp9d\" (UniqueName: \"kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d\") pod \"payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.798013 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.797932    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:01.843444 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.840394    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:01.952662 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.952630    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:54:01.954943 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:54:01.954911    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bd670a_edb9_47c3_8233_14fb6d34ac84.slice/crio-990add448744f16a8f8e9d85cce9d5843eed997b87b7481b8495a410fa59c165 WatchSource:0}: Error finding container 990add448744f16a8f8e9d85cce9d5843eed997b87b7481b8495a410fa59c165: Status 404 returned error can't find the container with id 990add448744f16a8f8e9d85cce9d5843eed997b87b7481b8495a410fa59c165
Jul 27 19:54:01.996845 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:01.996808    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:54:02.000841 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:54:02.000808    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395d85c3_299d_42a7_87af_3610bc42ffb5.slice/crio-235f70cc6be816fb11392365abb9ae03f299cf4809dc364be850209ed2294f02 WatchSource:0}: Error finding container 235f70cc6be816fb11392365abb9ae03f299cf4809dc364be850209ed2294f02: Status 404 returned error can't find the container with id 235f70cc6be816fb11392365abb9ae03f299cf4809dc364be850209ed2294f02
Jul 27 19:54:02.355489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.355387    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" event={"ID":"395d85c3-299d-42a7-87af-3610bc42ffb5","Type":"ContainerStarted","Data":"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"}
Jul 27 19:54:02.355489 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.355450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" event={"ID":"395d85c3-299d-42a7-87af-3610bc42ffb5","Type":"ContainerStarted","Data":"235f70cc6be816fb11392365abb9ae03f299cf4809dc364be850209ed2294f02"}
Jul 27 19:54:02.355714 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.355572    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:02.356926 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.356902    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" event={"ID":"33bd670a-edb9-47c3-8233-14fb6d34ac84","Type":"ContainerStarted","Data":"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"}
Jul 27 19:54:02.357065 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.356938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" event={"ID":"33bd670a-edb9-47c3-8233-14fb6d34ac84","Type":"ContainerStarted","Data":"990add448744f16a8f8e9d85cce9d5843eed997b87b7481b8495a410fa59c165"}
Jul 27 19:54:02.357065 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.356995    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:02.370587 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.370544    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" podStartSLOduration=1.3705310800000001 podStartE2EDuration="1.37053108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:02.368857493 +0000 UTC m=+2924.564826605" watchObservedRunningTime="2026-07-27 19:54:02.37053108 +0000 UTC m=+2924.566500167"
Jul 27 19:54:02.383132 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:02.383093    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" podStartSLOduration=1.3830806660000001 podStartE2EDuration="1.383080666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:02.382341402 +0000 UTC m=+2924.578310502" watchObservedRunningTime="2026-07-27 19:54:02.383080666 +0000 UTC m=+2924.579049757"
Jul 27 19:54:13.363253 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:13.363220    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:54:13.363704 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:13.363314    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:54:20.607969 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.607930    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:54:20.613352 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.613334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.615702 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.615680    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b78801\""
Jul 27 19:54:20.615804 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.615680    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b78801-dockercfg-9grhl\""
Jul 27 19:54:20.619917 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.619894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:54:20.660823 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.660791    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:54:20.664303 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.664289    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.691374 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.691345    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:54:20.758776 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.758750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.758776 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.758783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.758951 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.758814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd7wq\" (UniqueName: \"kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.758951 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.758832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79nm\" (UniqueName: \"kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.859377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.859308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.859377 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.859340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.859544 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.859473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd7wq\" (UniqueName: \"kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.859544 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.859506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79nm\" (UniqueName: \"kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.860102 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.860084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.860135 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.860096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.867900 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.867879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd7wq\" (UniqueName: \"kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq\") pod \"payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:20.867900 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.867882    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79nm\" (UniqueName: \"kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm\") pod \"payload-processing-e2e-ipp-b-b78801-5988855988-5mllg\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.925126 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.925095    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:20.973784 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:20.973755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:21.069557 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.069523    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:54:21.074466 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:54:21.074432    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e0d4de_1e59_437b_b34d_a0673108a5ac.slice/crio-ee947752f3a30edb317a33051188cf07a22a331f977e8f19214c2444d9b2eec5 WatchSource:0}: Error finding container ee947752f3a30edb317a33051188cf07a22a331f977e8f19214c2444d9b2eec5: Status 404 returned error can't find the container with id ee947752f3a30edb317a33051188cf07a22a331f977e8f19214c2444d9b2eec5
Jul 27 19:54:21.130468 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.130395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:54:21.133624 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:54:21.133594    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981013cc_cfa1_43f0_896e_dee8bfb65190.slice/crio-7a7d75a08a9b9df4435ca260cc514df0c822f567daef4c68d64fb390c91231c5 WatchSource:0}: Error finding container 7a7d75a08a9b9df4435ca260cc514df0c822f567daef4c68d64fb390c91231c5: Status 404 returned error can't find the container with id 7a7d75a08a9b9df4435ca260cc514df0c822f567daef4c68d64fb390c91231c5
Jul 27 19:54:21.450634 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.450555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" event={"ID":"981013cc-cfa1-43f0-896e-dee8bfb65190","Type":"ContainerStarted","Data":"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"}
Jul 27 19:54:21.450634 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.450604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" event={"ID":"981013cc-cfa1-43f0-896e-dee8bfb65190","Type":"ContainerStarted","Data":"7a7d75a08a9b9df4435ca260cc514df0c822f567daef4c68d64fb390c91231c5"}
Jul 27 19:54:21.450834 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.450673    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:21.452256 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.452233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" event={"ID":"78e0d4de-1e59-437b-b34d-a0673108a5ac","Type":"ContainerStarted","Data":"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"}
Jul 27 19:54:21.452376 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.452270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" event={"ID":"78e0d4de-1e59-437b-b34d-a0673108a5ac","Type":"ContainerStarted","Data":"ee947752f3a30edb317a33051188cf07a22a331f977e8f19214c2444d9b2eec5"}
Jul 27 19:54:21.452376 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.452289    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:21.470788 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.470745    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" podStartSLOduration=1.470732959 podStartE2EDuration="1.470732959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:21.468745152 +0000 UTC m=+2943.664714240" watchObservedRunningTime="2026-07-27 19:54:21.470732959 +0000 UTC m=+2943.666702048"
Jul 27 19:54:21.488024 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:21.487978    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" podStartSLOduration=1.487960996 podStartE2EDuration="1.487960996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:54:21.486507993 +0000 UTC m=+2943.682477082" watchObservedRunningTime="2026-07-27 19:54:21.487960996 +0000 UTC m=+2943.683930087"
Jul 27 19:54:32.459064 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:32.459016    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.51:9004: connect: connection refused"
Jul 27 19:54:32.459598 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:32.459578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:54:42.458398 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:42.458328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:54:51.953029 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:54:51.952998    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b78801-5988855988-5mllg_78e0d4de-1e59-437b-b34d-a0673108a5ac/payload-processing/0.log"
Jul 27 19:55:07.371659 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.371623    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:55:07.375814 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.375793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.380514 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.380484    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f227a8\"/\"default-dockercfg-vqvzp\""
Jul 27 19:55:07.380514 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.380487    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-f227a8\"/\"ipp-route-f227a8-kserve-self-signed-certs\""
Jul 27 19:55:07.380686 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.380532    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f227a8\"/\"kube-root-ca.crt\""
Jul 27 19:55:07.380686 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.380551    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-f227a8\"/\"openshift-service-ca.crt\""
Jul 27 19:55:07.385931 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.385911    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:55:07.474770 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.474934 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.474934 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.474934 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.475050 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8c9\" (UniqueName: \"kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.475050 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.474961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575658 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575668    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8c9\" (UniqueName: \"kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.575839 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.575780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.576220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.576042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.576220 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.576150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.576299 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.576252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.578193 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.578146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.578374 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.578358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.584771 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.584746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8c9\" (UniqueName: \"kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9\") pod \"ipp-route-f227a8-kserve-579475b7f-pztnw\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") " pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.686071 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.685992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:07.835264 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:07.835241    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:55:07.837923 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:55:07.837896    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd609c90d_0242_4601_b854_1b2fa2384169.slice/crio-208c57a57cd129731c14b2f8220046f37eb49a0badb290b33ac0e32dc1111281 WatchSource:0}: Error finding container 208c57a57cd129731c14b2f8220046f37eb49a0badb290b33ac0e32dc1111281: Status 404 returned error can't find the container with id 208c57a57cd129731c14b2f8220046f37eb49a0badb290b33ac0e32dc1111281
Jul 27 19:55:08.682320 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:08.682287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" event={"ID":"d609c90d-0242-4601-b854-1b2fa2384169","Type":"ContainerStarted","Data":"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"}
Jul 27 19:55:08.682725 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:08.682334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" event={"ID":"d609c90d-0242-4601-b854-1b2fa2384169","Type":"ContainerStarted","Data":"208c57a57cd129731c14b2f8220046f37eb49a0badb290b33ac0e32dc1111281"}
Jul 27 19:55:08.708075 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:08.708025    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" podStartSLOduration=1.708011216 podStartE2EDuration="1.708011216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:08.706431154 +0000 UTC m=+2990.902400244" watchObservedRunningTime="2026-07-27 19:55:08.708011216 +0000 UTC m=+2990.903980303"
Jul 27 19:55:17.686881 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:17.686847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:17.687384 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:17.686893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:17.699394 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:17.699371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:17.736963 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:17.736937    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:55:47.303505 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:47.303477    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477_395d85c3-299d-42a7-87af-3610bc42ffb5/payload-processing/0.log"
Jul 27 19:55:47.579316 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:47.579236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b78801-5988855988-5mllg_78e0d4de-1e59-437b-b34d-a0673108a5ac/payload-processing/0.log"
Jul 27 19:55:53.377884 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.377850    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:55:53.381576 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.381556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.383852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.383831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3ff2a8\""
Jul 27 19:55:53.383852 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.383850    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3ff2a8-dockercfg-h7w6k\""
Jul 27 19:55:53.395344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.395316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:55:53.496156 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.496128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.496349 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.496194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhpm\" (UniqueName: \"kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.596789 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.596758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.596983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.596824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhpm\" (UniqueName: \"kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.597540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.597519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.604723 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.604694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhpm\" (UniqueName: \"kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm\") pod \"payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.692436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.692356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.833912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.833885    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:55:53.835522 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:55:53.835482    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b84ba15_a340_4665_8a44_f5db5df7f5ca.slice/crio-1fd59c8eeef35b635679b03af72347e5ed4ee594d27550c4306fbe0a637aad5a WatchSource:0}: Error finding container 1fd59c8eeef35b635679b03af72347e5ed4ee594d27550c4306fbe0a637aad5a: Status 404 returned error can't find the container with id 1fd59c8eeef35b635679b03af72347e5ed4ee594d27550c4306fbe0a637aad5a
Jul 27 19:55:53.900470 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.900444    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" event={"ID":"6b84ba15-a340-4665-8a44-f5db5df7f5ca","Type":"ContainerStarted","Data":"727a4e1a9a26001b31bb75d4626588d42ea50028e3fd00d6d38361f0476837e0"}
Jul 27 19:55:53.900592 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.900500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" event={"ID":"6b84ba15-a340-4665-8a44-f5db5df7f5ca","Type":"ContainerStarted","Data":"1fd59c8eeef35b635679b03af72347e5ed4ee594d27550c4306fbe0a637aad5a"}
Jul 27 19:55:53.900592 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.900526    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:55:53.917961 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:55:53.917919    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" podStartSLOduration=0.917903404 podStartE2EDuration="917.903404ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:53.917109536 +0000 UTC m=+3036.113078637" watchObservedRunningTime="2026-07-27 19:55:53.917903404 +0000 UTC m=+3036.113872517"
Jul 27 19:56:04.907727 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:04.907681    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.53:9004: connect: connection refused"
Jul 27 19:56:14.907236 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:14.907127    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:56:27.894647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:27.894616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:56:27.895092 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:27.894857    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerName="payload-pre-processing" containerID="cri-o://727a4e1a9a26001b31bb75d4626588d42ea50028e3fd00d6d38361f0476837e0" gracePeriod=30
Jul 27 19:56:28.069098 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.069061    2558 generic.go:356] "Generic (PLEG): container finished" podID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerID="727a4e1a9a26001b31bb75d4626588d42ea50028e3fd00d6d38361f0476837e0" exitCode=0
Jul 27 19:56:28.069382 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.069140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" event={"ID":"6b84ba15-a340-4665-8a44-f5db5df7f5ca","Type":"ContainerDied","Data":"727a4e1a9a26001b31bb75d4626588d42ea50028e3fd00d6d38361f0476837e0"}
Jul 27 19:56:28.157622 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.157562    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:56:28.335617 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.335583    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume\") pod \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") "
Jul 27 19:56:28.335816 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.335687    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhpm\" (UniqueName: \"kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm\") pod \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\" (UID: \"6b84ba15-a340-4665-8a44-f5db5df7f5ca\") "
Jul 27 19:56:28.336059 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.336034    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b84ba15-a340-4665-8a44-f5db5df7f5ca" (UID: "6b84ba15-a340-4665-8a44-f5db5df7f5ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:28.338037 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.338011    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm" (OuterVolumeSpecName: "kube-api-access-lmhpm") pod "6b84ba15-a340-4665-8a44-f5db5df7f5ca" (UID: "6b84ba15-a340-4665-8a44-f5db5df7f5ca"). InnerVolumeSpecName "kube-api-access-lmhpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:28.437300 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.437214    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b84ba15-a340-4665-8a44-f5db5df7f5ca-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:28.437300 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:28.437244    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhpm\" (UniqueName: \"kubernetes.io/projected/6b84ba15-a340-4665-8a44-f5db5df7f5ca-kube-api-access-lmhpm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:29.075347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:29.075311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml" event={"ID":"6b84ba15-a340-4665-8a44-f5db5df7f5ca","Type":"ContainerDied","Data":"1fd59c8eeef35b635679b03af72347e5ed4ee594d27550c4306fbe0a637aad5a"}
Jul 27 19:56:29.075347 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:29.075344    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"
Jul 27 19:56:29.075874 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:29.075379    2558 scope.go:117] "RemoveContainer" containerID="727a4e1a9a26001b31bb75d4626588d42ea50028e3fd00d6d38361f0476837e0"
Jul 27 19:56:29.097475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:29.097436    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:56:29.099371 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:29.099348    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3ff2a8-8b4b47c6-gh2ml"]
Jul 27 19:56:30.249414 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:30.249381    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" path="/var/lib/kubelet/pods/6b84ba15-a340-4665-8a44-f5db5df7f5ca/volumes"
Jul 27 19:56:56.590221 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.590188    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:56:56.590738 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.590395    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" podUID="395d85c3-299d-42a7-87af-3610bc42ffb5" containerName="payload-processing" containerID="cri-o://f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c" gracePeriod=30
Jul 27 19:56:56.632886 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.632861    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:56:56.633079 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.633045    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" podUID="33bd670a-edb9-47c3-8233-14fb6d34ac84" containerName="payload-pre-processing" containerID="cri-o://676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75" gracePeriod=30
Jul 27 19:56:56.917394 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.917371    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:56:56.920022 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.920001    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:56:56.999870 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.999839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume\") pod \"395d85c3-299d-42a7-87af-3610bc42ffb5\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") "
Jul 27 19:56:57.000058 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:56.999979    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whp9d\" (UniqueName: \"kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d\") pod \"33bd670a-edb9-47c3-8233-14fb6d34ac84\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") "
Jul 27 19:56:57.000058 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.000050    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glsnn\" (UniqueName: \"kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn\") pod \"395d85c3-299d-42a7-87af-3610bc42ffb5\" (UID: \"395d85c3-299d-42a7-87af-3610bc42ffb5\") "
Jul 27 19:56:57.000222 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.000081    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume\") pod \"33bd670a-edb9-47c3-8233-14fb6d34ac84\" (UID: \"33bd670a-edb9-47c3-8233-14fb6d34ac84\") "
Jul 27 19:56:57.000301 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.000273    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "395d85c3-299d-42a7-87af-3610bc42ffb5" (UID: "395d85c3-299d-42a7-87af-3610bc42ffb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:57.000541 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.000500    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/395d85c3-299d-42a7-87af-3610bc42ffb5-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:57.000701 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.000638    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "33bd670a-edb9-47c3-8233-14fb6d34ac84" (UID: "33bd670a-edb9-47c3-8233-14fb6d34ac84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:56:57.002317 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.002293    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d" (OuterVolumeSpecName: "kube-api-access-whp9d") pod "33bd670a-edb9-47c3-8233-14fb6d34ac84" (UID: "33bd670a-edb9-47c3-8233-14fb6d34ac84"). InnerVolumeSpecName "kube-api-access-whp9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:57.002664 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.002649    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn" (OuterVolumeSpecName: "kube-api-access-glsnn") pod "395d85c3-299d-42a7-87af-3610bc42ffb5" (UID: "395d85c3-299d-42a7-87af-3610bc42ffb5"). InnerVolumeSpecName "kube-api-access-glsnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:56:57.101668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.101641    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whp9d\" (UniqueName: \"kubernetes.io/projected/33bd670a-edb9-47c3-8233-14fb6d34ac84-kube-api-access-whp9d\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:57.101668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.101666    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glsnn\" (UniqueName: \"kubernetes.io/projected/395d85c3-299d-42a7-87af-3610bc42ffb5-kube-api-access-glsnn\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:57.101668 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.101675    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33bd670a-edb9-47c3-8233-14fb6d34ac84-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:56:57.212642 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.212553    2558 generic.go:356] "Generic (PLEG): container finished" podID="395d85c3-299d-42a7-87af-3610bc42ffb5" containerID="f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c" exitCode=0
Jul 27 19:56:57.212642 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.212607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"
Jul 27 19:56:57.212642 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.212623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" event={"ID":"395d85c3-299d-42a7-87af-3610bc42ffb5","Type":"ContainerDied","Data":"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"}
Jul 27 19:56:57.212896 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.212681    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477" event={"ID":"395d85c3-299d-42a7-87af-3610bc42ffb5","Type":"ContainerDied","Data":"235f70cc6be816fb11392365abb9ae03f299cf4809dc364be850209ed2294f02"}
Jul 27 19:56:57.212896 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.212715    2558 scope.go:117] "RemoveContainer" containerID="f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"
Jul 27 19:56:57.214096 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.214066    2558 generic.go:356] "Generic (PLEG): container finished" podID="33bd670a-edb9-47c3-8233-14fb6d34ac84" containerID="676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75" exitCode=0
Jul 27 19:56:57.214233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.214112    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"
Jul 27 19:56:57.214233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.214212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" event={"ID":"33bd670a-edb9-47c3-8233-14fb6d34ac84","Type":"ContainerDied","Data":"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"}
Jul 27 19:56:57.214330 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.214249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt" event={"ID":"33bd670a-edb9-47c3-8233-14fb6d34ac84","Type":"ContainerDied","Data":"990add448744f16a8f8e9d85cce9d5843eed997b87b7481b8495a410fa59c165"}
Jul 27 19:56:57.221990 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.221978    2558 scope.go:117] "RemoveContainer" containerID="f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"
Jul 27 19:56:57.222344 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:56:57.222322    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c\": container with ID starting with f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c not found: ID does not exist" containerID="f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"
Jul 27 19:56:57.222442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.222354    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c"} err="failed to get container status \"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c\": rpc error: code = NotFound desc = could not find container \"f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c\": container with ID starting with f88e52575707e32e2baad5b255732281346766fdbc1ba5e0764aa27feb06a73c not found: ID does not exist"
Jul 27 19:56:57.222442 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.222375    2558 scope.go:117] "RemoveContainer" containerID="676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"
Jul 27 19:56:57.231399 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.231382    2558 scope.go:117] "RemoveContainer" containerID="676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"
Jul 27 19:56:57.231648 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:56:57.231630    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75\": container with ID starting with 676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75 not found: ID does not exist" containerID="676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"
Jul 27 19:56:57.231705 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.231654    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75"} err="failed to get container status \"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75\": rpc error: code = NotFound desc = could not find container \"676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75\": container with ID starting with 676e89a6b4eb1872bd7d22b97d3f1ab431e1b97e0d918c8325b2e2449100da75 not found: ID does not exist"
Jul 27 19:56:57.247393 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.247371    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:56:57.263917 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.263890    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f227a8-6b9bb5d644-2msqt"]
Jul 27 19:56:57.286183 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.286151    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:56:57.291944 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:57.291925    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f227a8-777ddd4b74-n8477"]
Jul 27 19:56:58.258530 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:58.258500    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33bd670a-edb9-47c3-8233-14fb6d34ac84" path="/var/lib/kubelet/pods/33bd670a-edb9-47c3-8233-14fb6d34ac84/volumes"
Jul 27 19:56:58.259016 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:56:58.259000    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="395d85c3-299d-42a7-87af-3610bc42ffb5" path="/var/lib/kubelet/pods/395d85c3-299d-42a7-87af-3610bc42ffb5/volumes"
Jul 27 19:57:02.349250 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:02.349220    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:57:17.368932 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.368871    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" podUID="d609c90d-0242-4601-b854-1b2fa2384169" containerName="main" containerID="cri-o://ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a" gracePeriod=45
Jul 27 19:57:17.620869 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.620808    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:57:17.791912 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.791880    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw8c9\" (UniqueName: \"kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.791946    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.791974    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.791996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.792012    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792100 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.792067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir\") pod \"d609c90d-0242-4601-b854-1b2fa2384169\" (UID: \"d609c90d-0242-4601-b854-1b2fa2384169\") "
Jul 27 19:57:17.792418 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.792368    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache" (OuterVolumeSpecName: "model-cache") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:17.792418 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.792381    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:17.792570 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.792548    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home" (OuterVolumeSpecName: "home") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:17.794369 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.794339    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 19:57:17.794369 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.794362    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm" (OuterVolumeSpecName: "dshm") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 19:57:17.794508 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.794375    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9" (OuterVolumeSpecName: "kube-api-access-rw8c9") pod "d609c90d-0242-4601-b854-1b2fa2384169" (UID: "d609c90d-0242-4601-b854-1b2fa2384169"). InnerVolumeSpecName "kube-api-access-rw8c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893544    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d609c90d-0242-4601-b854-1b2fa2384169-tls-certs\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893568    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-dshm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893577    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-home\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893585    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-tmp-dir\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893593    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw8c9\" (UniqueName: \"kubernetes.io/projected/d609c90d-0242-4601-b854-1b2fa2384169-kube-api-access-rw8c9\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:17.893613 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:17.893601    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d609c90d-0242-4601-b854-1b2fa2384169-model-cache\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:57:18.314381 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.314349    2558 generic.go:356] "Generic (PLEG): container finished" podID="d609c90d-0242-4601-b854-1b2fa2384169" containerID="ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a" exitCode=0
Jul 27 19:57:18.314536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.314392    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"
Jul 27 19:57:18.314536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.314380    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" event={"ID":"d609c90d-0242-4601-b854-1b2fa2384169","Type":"ContainerDied","Data":"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"}
Jul 27 19:57:18.314536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.314429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw" event={"ID":"d609c90d-0242-4601-b854-1b2fa2384169","Type":"ContainerDied","Data":"208c57a57cd129731c14b2f8220046f37eb49a0badb290b33ac0e32dc1111281"}
Jul 27 19:57:18.314536 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.314447    2558 scope.go:117] "RemoveContainer" containerID="ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"
Jul 27 19:57:18.322907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.322889    2558 scope.go:117] "RemoveContainer" containerID="ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"
Jul 27 19:57:18.323199 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:57:18.323156    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a\": container with ID starting with ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a not found: ID does not exist" containerID="ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"
Jul 27 19:57:18.323306 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.323200    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a"} err="failed to get container status \"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a\": rpc error: code = NotFound desc = could not find container \"ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a\": container with ID starting with ac1dc87014fdb02cd9225e9a498620dd747a462a9b63f43c08bddbafa71f042a not found: ID does not exist"
Jul 27 19:57:18.331836 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.331814    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:57:18.336248 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:18.336227    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-f227a8/ipp-route-f227a8-kserve-579475b7f-pztnw"]
Jul 27 19:57:20.249648 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:57:20.249619    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d609c90d-0242-4601-b854-1b2fa2384169" path="/var/lib/kubelet/pods/d609c90d-0242-4601-b854-1b2fa2384169/volumes"
Jul 27 19:58:04.032671 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.032640    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:58:04.033236 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.032876    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" podUID="78e0d4de-1e59-437b-b34d-a0673108a5ac" containerName="payload-processing" containerID="cri-o://9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03" gracePeriod=30
Jul 27 19:58:04.043804 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.043771    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:58:04.044044 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.044003    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerName="payload-pre-processing" containerID="cri-o://2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba" gracePeriod=30
Jul 27 19:58:04.325647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.325622    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:58:04.328270 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.328253    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:58:04.424408 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd7wq\" (UniqueName: \"kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq\") pod \"981013cc-cfa1-43f0-896e-dee8bfb65190\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") "
Jul 27 19:58:04.424568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424447    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume\") pod \"78e0d4de-1e59-437b-b34d-a0673108a5ac\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") "
Jul 27 19:58:04.424568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424493    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume\") pod \"981013cc-cfa1-43f0-896e-dee8bfb65190\" (UID: \"981013cc-cfa1-43f0-896e-dee8bfb65190\") "
Jul 27 19:58:04.424568 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424515    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m79nm\" (UniqueName: \"kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm\") pod \"78e0d4de-1e59-437b-b34d-a0673108a5ac\" (UID: \"78e0d4de-1e59-437b-b34d-a0673108a5ac\") "
Jul 27 19:58:04.424864 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424839    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "78e0d4de-1e59-437b-b34d-a0673108a5ac" (UID: "78e0d4de-1e59-437b-b34d-a0673108a5ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:04.424917 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.424900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "981013cc-cfa1-43f0-896e-dee8bfb65190" (UID: "981013cc-cfa1-43f0-896e-dee8bfb65190"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:04.426950 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.426925    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm" (OuterVolumeSpecName: "kube-api-access-m79nm") pod "78e0d4de-1e59-437b-b34d-a0673108a5ac" (UID: "78e0d4de-1e59-437b-b34d-a0673108a5ac"). InnerVolumeSpecName "kube-api-access-m79nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:04.427072 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.426955    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq" (OuterVolumeSpecName: "kube-api-access-sd7wq") pod "981013cc-cfa1-43f0-896e-dee8bfb65190" (UID: "981013cc-cfa1-43f0-896e-dee8bfb65190"). InnerVolumeSpecName "kube-api-access-sd7wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:04.525273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.525246    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/981013cc-cfa1-43f0-896e-dee8bfb65190-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.525273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.525268    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m79nm\" (UniqueName: \"kubernetes.io/projected/78e0d4de-1e59-437b-b34d-a0673108a5ac-kube-api-access-m79nm\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.525273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.525279    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd7wq\" (UniqueName: \"kubernetes.io/projected/981013cc-cfa1-43f0-896e-dee8bfb65190-kube-api-access-sd7wq\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.525476 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.525287    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78e0d4de-1e59-437b-b34d-a0673108a5ac-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:04.533234 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.533207    2558 generic.go:356] "Generic (PLEG): container finished" podID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerID="2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba" exitCode=0
Jul 27 19:58:04.533352 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.533257    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"
Jul 27 19:58:04.533352 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.533300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" event={"ID":"981013cc-cfa1-43f0-896e-dee8bfb65190","Type":"ContainerDied","Data":"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"}
Jul 27 19:58:04.533434 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.533360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv" event={"ID":"981013cc-cfa1-43f0-896e-dee8bfb65190","Type":"ContainerDied","Data":"7a7d75a08a9b9df4435ca260cc514df0c822f567daef4c68d64fb390c91231c5"}
Jul 27 19:58:04.533434 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.533389    2558 scope.go:117] "RemoveContainer" containerID="2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"
Jul 27 19:58:04.534663 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.534636    2558 generic.go:356] "Generic (PLEG): container finished" podID="78e0d4de-1e59-437b-b34d-a0673108a5ac" containerID="9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03" exitCode=0
Jul 27 19:58:04.534772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.534675    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"
Jul 27 19:58:04.534772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.534676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" event={"ID":"78e0d4de-1e59-437b-b34d-a0673108a5ac","Type":"ContainerDied","Data":"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"}
Jul 27 19:58:04.534772 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.534722    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg" event={"ID":"78e0d4de-1e59-437b-b34d-a0673108a5ac","Type":"ContainerDied","Data":"ee947752f3a30edb317a33051188cf07a22a331f977e8f19214c2444d9b2eec5"}
Jul 27 19:58:04.542344 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.542313    2558 scope.go:117] "RemoveContainer" containerID="2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"
Jul 27 19:58:04.542715 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:58:04.542694    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba\": container with ID starting with 2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba not found: ID does not exist" containerID="2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"
Jul 27 19:58:04.542792 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.542722    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba"} err="failed to get container status \"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba\": rpc error: code = NotFound desc = could not find container \"2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba\": container with ID starting with 2f3c9d999a760b63d6f664e85cc80a1ed999b238e49a235264b7eedfe176faba not found: ID does not exist"
Jul 27 19:58:04.542792 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.542740    2558 scope.go:117] "RemoveContainer" containerID="9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"
Jul 27 19:58:04.550795 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.550781    2558 scope.go:117] "RemoveContainer" containerID="9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"
Jul 27 19:58:04.551026 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:58:04.551009    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03\": container with ID starting with 9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03 not found: ID does not exist" containerID="9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"
Jul 27 19:58:04.551071 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.551031    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03"} err="failed to get container status \"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03\": rpc error: code = NotFound desc = could not find container \"9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03\": container with ID starting with 9f56ad34a53110ffcc19d563b5b162e08dcb2b66d8a543410a3e08ff56fa6f03 not found: ID does not exist"
Jul 27 19:58:04.558368 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.558348    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:58:04.560983 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.560963    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b78801-bd8698dfb-7stpv"]
Jul 27 19:58:04.573023 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.573003    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:58:04.577787 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:04.577769    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b78801-5988855988-5mllg"]
Jul 27 19:58:06.249935 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:06.249900    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e0d4de-1e59-437b-b34d-a0673108a5ac" path="/var/lib/kubelet/pods/78e0d4de-1e59-437b-b34d-a0673108a5ac/volumes"
Jul 27 19:58:06.250352 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:06.250290    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" path="/var/lib/kubelet/pods/981013cc-cfa1-43f0-896e-dee8bfb65190/volumes"
Jul 27 19:58:22.514938 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.514905    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:58:22.515475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.515187    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" podUID="16cf35ae-bb60-486d-82b1-595954bd5368" containerName="payload-processing" containerID="cri-o://ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee" gracePeriod=30
Jul 27 19:58:22.524413 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.524387    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:58:22.524645 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.524620    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" podUID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" containerName="payload-pre-processing" containerID="cri-o://e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203" gracePeriod=30
Jul 27 19:58:22.817836 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.817815    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:58:22.820500 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.820482    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:58:22.893298 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893274    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd96n\" (UniqueName: \"kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n\") pod \"16cf35ae-bb60-486d-82b1-595954bd5368\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") "
Jul 27 19:58:22.893457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q86p\" (UniqueName: \"kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p\") pod \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") "
Jul 27 19:58:22.893457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume\") pod \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\" (UID: \"ed742b51-35b1-4085-b15c-f5e7ed570cd4\") "
Jul 27 19:58:22.893457 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893407    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume\") pod \"16cf35ae-bb60-486d-82b1-595954bd5368\" (UID: \"16cf35ae-bb60-486d-82b1-595954bd5368\") "
Jul 27 19:58:22.893743 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893714    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed742b51-35b1-4085-b15c-f5e7ed570cd4" (UID: "ed742b51-35b1-4085-b15c-f5e7ed570cd4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:22.893849 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.893823    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "16cf35ae-bb60-486d-82b1-595954bd5368" (UID: "16cf35ae-bb60-486d-82b1-595954bd5368"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:22.895436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.895412    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n" (OuterVolumeSpecName: "kube-api-access-xd96n") pod "16cf35ae-bb60-486d-82b1-595954bd5368" (UID: "16cf35ae-bb60-486d-82b1-595954bd5368"). InnerVolumeSpecName "kube-api-access-xd96n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:22.895505 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.895489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p" (OuterVolumeSpecName: "kube-api-access-6q86p") pod "ed742b51-35b1-4085-b15c-f5e7ed570cd4" (UID: "ed742b51-35b1-4085-b15c-f5e7ed570cd4"). InnerVolumeSpecName "kube-api-access-6q86p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:22.994869 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.994839    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd96n\" (UniqueName: \"kubernetes.io/projected/16cf35ae-bb60-486d-82b1-595954bd5368-kube-api-access-xd96n\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:22.994869 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.994864    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q86p\" (UniqueName: \"kubernetes.io/projected/ed742b51-35b1-4085-b15c-f5e7ed570cd4-kube-api-access-6q86p\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:22.994869 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.994872    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed742b51-35b1-4085-b15c-f5e7ed570cd4-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:22.995064 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:22.994881    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16cf35ae-bb60-486d-82b1-595954bd5368-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:23.623571 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.623536    2558 generic.go:356] "Generic (PLEG): container finished" podID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" containerID="e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203" exitCode=0
Jul 27 19:58:23.624031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.623578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"
Jul 27 19:58:23.624031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.623625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" event={"ID":"ed742b51-35b1-4085-b15c-f5e7ed570cd4","Type":"ContainerDied","Data":"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"}
Jul 27 19:58:23.624031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.623678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd" event={"ID":"ed742b51-35b1-4085-b15c-f5e7ed570cd4","Type":"ContainerDied","Data":"59858ae8ec62fa23fcbbf06e7c6710434f87608b4055052bd1300bb8f6c97b1b"}
Jul 27 19:58:23.624031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.623702    2558 scope.go:117] "RemoveContainer" containerID="e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"
Jul 27 19:58:23.625046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.624895    2558 generic.go:356] "Generic (PLEG): container finished" podID="16cf35ae-bb60-486d-82b1-595954bd5368" containerID="ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee" exitCode=0
Jul 27 19:58:23.625046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.624949    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"
Jul 27 19:58:23.625046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.624924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" event={"ID":"16cf35ae-bb60-486d-82b1-595954bd5368","Type":"ContainerDied","Data":"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"}
Jul 27 19:58:23.625046 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.625011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw" event={"ID":"16cf35ae-bb60-486d-82b1-595954bd5368","Type":"ContainerDied","Data":"bd5b2c078253bbee19f6f5f5979c0c6573b37ebefc82f081901740ca7492431c"}
Jul 27 19:58:23.633672 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.633504    2558 scope.go:117] "RemoveContainer" containerID="e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"
Jul 27 19:58:23.633819 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:58:23.633770    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203\": container with ID starting with e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203 not found: ID does not exist" containerID="e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"
Jul 27 19:58:23.633819 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.633803    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203"} err="failed to get container status \"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203\": rpc error: code = NotFound desc = could not find container \"e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203\": container with ID starting with e1113ff86f5c6ff8f6090bccaecb1fce464a74048ab98756d6147a72f1c19203 not found: ID does not exist"
Jul 27 19:58:23.633932 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.633825    2558 scope.go:117] "RemoveContainer" containerID="ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"
Jul 27 19:58:23.641475 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.641457    2558 scope.go:117] "RemoveContainer" containerID="ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"
Jul 27 19:58:23.641717 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:58:23.641699    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee\": container with ID starting with ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee not found: ID does not exist" containerID="ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"
Jul 27 19:58:23.641776 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.641727    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee"} err="failed to get container status \"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee\": rpc error: code = NotFound desc = could not find container \"ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee\": container with ID starting with ea414d86625557058f6cc0723c82148043bbac3d30532f3a53ec0d1c703341ee not found: ID does not exist"
Jul 27 19:58:23.650592 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.650568    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:58:23.658240 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.658220    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-b4cd12-789fd8bdf6-429wd"]
Jul 27 19:58:23.670784 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.670756    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:58:23.673026 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:23.672997    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-b4cd12-7b876f55f4-zqgpw"]
Jul 27 19:58:24.254715 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:24.254674    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16cf35ae-bb60-486d-82b1-595954bd5368" path="/var/lib/kubelet/pods/16cf35ae-bb60-486d-82b1-595954bd5368/volumes"
Jul 27 19:58:24.255179 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:24.255148    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" path="/var/lib/kubelet/pods/ed742b51-35b1-4085-b15c-f5e7ed570cd4/volumes"
Jul 27 19:58:41.368390 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.368363    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:58:41.368817 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.368576    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" podUID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" containerName="payload-processing" containerID="cri-o://e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5" gracePeriod=30
Jul 27 19:58:41.614545 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.614520    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:58:41.663600 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.663523    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-425p6\" (UniqueName: \"kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6\") pod \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") "
Jul 27 19:58:41.663730 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.663604    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume\") pod \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\" (UID: \"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5\") "
Jul 27 19:58:41.663959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.663940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" (UID: "d4590d62-2c02-4aaa-93a8-2bf62cbfceb5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:58:41.665766 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.665746    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6" (OuterVolumeSpecName: "kube-api-access-425p6") pod "d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" (UID: "d4590d62-2c02-4aaa-93a8-2bf62cbfceb5"). InnerVolumeSpecName "kube-api-access-425p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:58:41.708685 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.708649    2558 generic.go:356] "Generic (PLEG): container finished" podID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" containerID="e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5" exitCode=0
Jul 27 19:58:41.708796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.708690    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"
Jul 27 19:58:41.708796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.708708    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" event={"ID":"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5","Type":"ContainerDied","Data":"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"}
Jul 27 19:58:41.708796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.708762    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj" event={"ID":"d4590d62-2c02-4aaa-93a8-2bf62cbfceb5","Type":"ContainerDied","Data":"bcedca1a90f94e79337a4230f277620edc847efff8a41d6c98e3a20ed81ca6dd"}
Jul 27 19:58:41.708796 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.708793    2558 scope.go:117] "RemoveContainer" containerID="e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"
Jul 27 19:58:41.718586 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.718571    2558 scope.go:117] "RemoveContainer" containerID="e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"
Jul 27 19:58:41.718856 ip-10-0-132-61 kubenswrapper[2558]: E0727 19:58:41.718827    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5\": container with ID starting with e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5 not found: ID does not exist" containerID="e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"
Jul 27 19:58:41.718899 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.718871    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5"} err="failed to get container status \"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5\": rpc error: code = NotFound desc = could not find container \"e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5\": container with ID starting with e4300ee2974946d682a5e058b79e10acbc3c93feb9c9ec83718c057db695e0a5 not found: ID does not exist"
Jul 27 19:58:41.738909 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.738883    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:58:41.747596 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.747574    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-70aa40-7b576cd6fd-j2gpj"]
Jul 27 19:58:41.764272 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.764253    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-425p6\" (UniqueName: \"kubernetes.io/projected/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-kube-api-access-425p6\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:41.764272 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:41.764269    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5-plugins-config-volume\") on node \"ip-10-0-132-61.ec2.internal\" DevicePath \"\""
Jul 27 19:58:42.249736 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:42.249705    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" path="/var/lib/kubelet/pods/d4590d62-2c02-4aaa-93a8-2bf62cbfceb5/volumes"
Jul 27 19:58:55.645758 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:55.645728    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l8c4h_cbbd8b34-591f-40e8-a7cb-be09fc0214b9/server/0.log"
Jul 27 19:58:56.078420 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:56.078392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-mlm9z_15cd3c92-47d6-400e-93b0-641893211c00/copy-manifests/0.log"
Jul 27 19:58:56.088229 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:56.088212    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-mlm9z_15cd3c92-47d6-400e-93b0-641893211c00/manager/0.log"
Jul 27 19:58:58.649218 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:58.649162    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ggkf5_6626ff50-2877-43c5-bf1c-9e832ef1472d/manager/0.log"
Jul 27 19:58:59.144693 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:58:59.144662    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-799mt_36522525-ecfa-4abf-9eef-a6d0714edc87/manager/0.log"
Jul 27 19:59:00.072817 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:00.072786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-88vhs_09542220-f6ff-433a-b919-033b029df572/kube-auth-proxy/0.log"
Jul 27 19:59:01.587644 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:01.587605    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8dfbp_12944852-a01e-4bf4-b1da-2310886e0ba0/main/0.log"
Jul 27 19:59:01.715209 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:01.715156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-2g5qw_a8f9625d-364b-4d40-a3e0-92ba0833023b/main/0.log"
Jul 27 19:59:07.843971 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.843939    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hwxjc/must-gather-wqqb9"]
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844320    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e0d4de-1e59-437b-b34d-a0673108a5ac" containerName="payload-processing"
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844333    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e0d4de-1e59-437b-b34d-a0673108a5ac" containerName="payload-processing"
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844343    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerName="payload-pre-processing"
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844352    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerName="payload-pre-processing"
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844362    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33bd670a-edb9-47c3-8233-14fb6d34ac84" containerName="payload-pre-processing"
Jul 27 19:59:07.844367 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844368    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="33bd670a-edb9-47c3-8233-14fb6d34ac84" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844376    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844381    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844389    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="395d85c3-299d-42a7-87af-3610bc42ffb5" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844395    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="395d85c3-299d-42a7-87af-3610bc42ffb5" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844405    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844409    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844414    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d609c90d-0242-4601-b854-1b2fa2384169" containerName="main"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844423    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d609c90d-0242-4601-b854-1b2fa2384169" containerName="main"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844435    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cf35ae-bb60-486d-82b1-595954bd5368" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844441    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cf35ae-bb60-486d-82b1-595954bd5368" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844450    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844454    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844534    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="981013cc-cfa1-43f0-896e-dee8bfb65190" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844544    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed742b51-35b1-4085-b15c-f5e7ed570cd4" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844550    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e0d4de-1e59-437b-b34d-a0673108a5ac" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844555    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4590d62-2c02-4aaa-93a8-2bf62cbfceb5" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844561    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b84ba15-a340-4665-8a44-f5db5df7f5ca" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844567    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cf35ae-bb60-486d-82b1-595954bd5368" containerName="payload-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844572    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d609c90d-0242-4601-b854-1b2fa2384169" containerName="main"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844580    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="33bd670a-edb9-47c3-8233-14fb6d34ac84" containerName="payload-pre-processing"
Jul 27 19:59:07.844591 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.844589    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="395d85c3-299d-42a7-87af-3610bc42ffb5" containerName="payload-processing"
Jul 27 19:59:07.847762 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.847744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:07.850426 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.850406    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"kube-root-ca.crt\""
Jul 27 19:59:07.850522 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.850409    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hwxjc\"/\"openshift-service-ca.crt\""
Jul 27 19:59:07.858647 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:07.858627    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/must-gather-wqqb9"]
Jul 27 19:59:08.002718 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.002687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e4e8ea3-3812-4886-8ac5-34381106d915-must-gather-output\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.002888 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.002803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8w9p\" (UniqueName: \"kubernetes.io/projected/6e4e8ea3-3812-4886-8ac5-34381106d915-kube-api-access-t8w9p\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.103629 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.103564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8w9p\" (UniqueName: \"kubernetes.io/projected/6e4e8ea3-3812-4886-8ac5-34381106d915-kube-api-access-t8w9p\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.103629 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.103612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e4e8ea3-3812-4886-8ac5-34381106d915-must-gather-output\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.103959 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.103941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6e4e8ea3-3812-4886-8ac5-34381106d915-must-gather-output\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.113307 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.113286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8w9p\" (UniqueName: \"kubernetes.io/projected/6e4e8ea3-3812-4886-8ac5-34381106d915-kube-api-access-t8w9p\") pod \"must-gather-wqqb9\" (UID: \"6e4e8ea3-3812-4886-8ac5-34381106d915\") " pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.156895 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.156871    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/must-gather-wqqb9"
Jul 27 19:59:08.287007 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.286940    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/must-gather-wqqb9"]
Jul 27 19:59:08.289249 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:59:08.289213    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e4e8ea3_3812_4886_8ac5_34381106d915.slice/crio-a56e5c19b6326cb4a403fc81ca945e3dbe795eda12c2a6f56670bd22c91fd261 WatchSource:0}: Error finding container a56e5c19b6326cb4a403fc81ca945e3dbe795eda12c2a6f56670bd22c91fd261: Status 404 returned error can't find the container with id a56e5c19b6326cb4a403fc81ca945e3dbe795eda12c2a6f56670bd22c91fd261
Jul 27 19:59:08.290984 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.290967    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:59:08.832236 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:08.832203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/must-gather-wqqb9" event={"ID":"6e4e8ea3-3812-4886-8ac5-34381106d915","Type":"ContainerStarted","Data":"a56e5c19b6326cb4a403fc81ca945e3dbe795eda12c2a6f56670bd22c91fd261"}
Jul 27 19:59:09.840114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:09.840079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/must-gather-wqqb9" event={"ID":"6e4e8ea3-3812-4886-8ac5-34381106d915","Type":"ContainerStarted","Data":"0ab61e23c7e9c347a57c04eab2cea9c0bda778f596b2ccda316dbe6e205e9f24"}
Jul 27 19:59:09.841516 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:09.841486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/must-gather-wqqb9" event={"ID":"6e4e8ea3-3812-4886-8ac5-34381106d915","Type":"ContainerStarted","Data":"e1af1e6ed6d78203afde81f4af44adddb990e448c8ebe1ec015af6cb8cc4d7ef"}
Jul 27 19:59:09.859698 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:09.859631    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hwxjc/must-gather-wqqb9" podStartSLOduration=1.933515533 podStartE2EDuration="2.859611384s" totalImagesPullingTime="926.095851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:09.858077628 +0000 UTC m=+3232.054046741" watchObservedRunningTime="2026-07-27 19:59:09.859611384 +0000 UTC m=+3232.055580475"
Jul 27 19:59:10.839438 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:10.839413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5c8wf_33c330a1-7274-45b0-9753-cd623bc66ee7/global-pull-secret-syncer/0.log"
Jul 27 19:59:11.058334 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:11.058302    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xhgtk_94b09010-04b5-455f-8ba8-a64d0a523287/konnectivity-agent/0.log"
Jul 27 19:59:11.084400 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:11.084371    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-61.ec2.internal_da79ada79033cdf20af7c0b236d8437a/haproxy/0.log"
Jul 27 19:59:15.389058 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:15.389007    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ggkf5_6626ff50-2877-43c5-bf1c-9e832ef1472d/manager/0.log"
Jul 27 19:59:15.749001 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:15.748747    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-799mt_36522525-ecfa-4abf-9eef-a6d0714edc87/manager/0.log"
Jul 27 19:59:17.907737 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:17.907652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9x4nv_8122233e-5b57-48af-875c-7d59ddfb82e1/kube-state-metrics/0.log"
Jul 27 19:59:17.936031 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:17.936003    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9x4nv_8122233e-5b57-48af-875c-7d59ddfb82e1/kube-rbac-proxy-main/0.log"
Jul 27 19:59:17.967104 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:17.967027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9x4nv_8122233e-5b57-48af-875c-7d59ddfb82e1/kube-rbac-proxy-self/0.log"
Jul 27 19:59:18.020493 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.020457    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f67cbfd8b-f6zwt_7d45946b-6b5b-4b0b-a9ed-b6a4bcd38ce4/metrics-server/0.log"
Jul 27 19:59:18.096615 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.096579    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2m2s_43518ac6-4231-48df-b745-a86990296b9f/node-exporter/0.log"
Jul 27 19:59:18.123677 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.123648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2m2s_43518ac6-4231-48df-b745-a86990296b9f/kube-rbac-proxy/0.log"
Jul 27 19:59:18.153233 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.153060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k2m2s_43518ac6-4231-48df-b745-a86990296b9f/init-textfile/0.log"
Jul 27 19:59:18.368466 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.368434    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xc2sl_986ff011-2f2c-4b92-b980-d979f7b89c5c/kube-rbac-proxy-main/0.log"
Jul 27 19:59:18.391780 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.391746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xc2sl_986ff011-2f2c-4b92-b980-d979f7b89c5c/kube-rbac-proxy-self/0.log"
Jul 27 19:59:18.419054 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.419021    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xc2sl_986ff011-2f2c-4b92-b980-d979f7b89c5c/openshift-state-metrics/0.log"
Jul 27 19:59:18.472594 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.472557    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/prometheus/0.log"
Jul 27 19:59:18.499828 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.499786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/config-reloader/0.log"
Jul 27 19:59:18.529680 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.529634    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/thanos-sidecar/0.log"
Jul 27 19:59:18.558794 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.558767    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/kube-rbac-proxy-web/0.log"
Jul 27 19:59:18.591540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.591510    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/kube-rbac-proxy/0.log"
Jul 27 19:59:18.616545 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.616517    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/kube-rbac-proxy-thanos/0.log"
Jul 27 19:59:18.649380 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.649304    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad4d8e33-9006-472b-9cb3-dd26b5acbf89/init-config-reloader/0.log"
Jul 27 19:59:18.688058 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.688032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v5ktz_7d439e40-7ac6-407c-b893-a0748247a967/prometheus-operator/0.log"
Jul 27 19:59:18.723654 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.723623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v5ktz_7d439e40-7ac6-407c-b893-a0748247a967/kube-rbac-proxy/0.log"
Jul 27 19:59:18.764140 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.764088    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-bpz6p_5c2276f4-a086-4d48-8eb7-d74d30842e34/prometheus-operator-admission-webhook/0.log"
Jul 27 19:59:18.805596 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.805553    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b6bfc984-hcsmv_70b2cef4-ea6a-46a9-a77a-7f78100b4f9c/telemeter-client/0.log"
Jul 27 19:59:18.839910 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.839871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b6bfc984-hcsmv_70b2cef4-ea6a-46a9-a77a-7f78100b4f9c/reload/0.log"
Jul 27 19:59:18.867723 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:18.867694    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57b6bfc984-hcsmv_70b2cef4-ea6a-46a9-a77a-7f78100b4f9c/kube-rbac-proxy/0.log"
Jul 27 19:59:21.130056 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.130007    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"]
Jul 27 19:59:21.138634 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.138599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.142451 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.142423    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hwxjc\"/\"default-dockercfg-g7p4f\""
Jul 27 19:59:21.152309 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.152280    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"]
Jul 27 19:59:21.173540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.166230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-sys\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.173540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.166269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-podres\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.173540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.166315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkm6m\" (UniqueName: \"kubernetes.io/projected/b4325a81-3dc7-4d36-bd7d-67f9672bc089-kube-api-access-rkm6m\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.173540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.166388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-lib-modules\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.173540 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.166428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-proc\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267206 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-lib-modules\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-proc\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-sys\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-podres\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267342    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-lib-modules\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267391 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm6m\" (UniqueName: \"kubernetes.io/projected/b4325a81-3dc7-4d36-bd7d-67f9672bc089-kube-api-access-rkm6m\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267610 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-sys\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267610 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267521    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-proc\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.267610 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.267593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b4325a81-3dc7-4d36-bd7d-67f9672bc089-podres\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.280416 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.280389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkm6m\" (UniqueName: \"kubernetes.io/projected/b4325a81-3dc7-4d36-bd7d-67f9672bc089-kube-api-access-rkm6m\") pod \"perf-node-gather-daemonset-2vntk\" (UID: \"b4325a81-3dc7-4d36-bd7d-67f9672bc089\") " pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.453954 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.453865    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:21.656436 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.653451    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"]
Jul 27 19:59:21.660876 ip-10-0-132-61 kubenswrapper[2558]: W0727 19:59:21.660839    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb4325a81_3dc7_4d36_bd7d_67f9672bc089.slice/crio-88e0682c95932067ee81535739b677b9477a3764840844204a71d030dcc7bb7e WatchSource:0}: Error finding container 88e0682c95932067ee81535739b677b9477a3764840844204a71d030dcc7bb7e: Status 404 returned error can't find the container with id 88e0682c95932067ee81535739b677b9477a3764840844204a71d030dcc7bb7e
Jul 27 19:59:21.918716 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.918681    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk" event={"ID":"b4325a81-3dc7-4d36-bd7d-67f9672bc089","Type":"ContainerStarted","Data":"da715112a04609939d86a12ea52f1c7bb7fbbaee7c56faa33fb96a4a43189782"}
Jul 27 19:59:21.918907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.918743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk" event={"ID":"b4325a81-3dc7-4d36-bd7d-67f9672bc089","Type":"ContainerStarted","Data":"88e0682c95932067ee81535739b677b9477a3764840844204a71d030dcc7bb7e"}
Jul 27 19:59:21.918907 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:21.918807    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:23.482275 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:23.482233    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fb297_aace3cc5-3286-4d8f-98e9-7f6256e57858/dns/0.log"
Jul 27 19:59:23.516462 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:23.516433    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fb297_aace3cc5-3286-4d8f-98e9-7f6256e57858/kube-rbac-proxy/0.log"
Jul 27 19:59:23.688407 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:23.688377    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lq65n_c534fe2f-60b6-4a0a-bd85-520e1e6ed07f/dns-node-resolver/0.log"
Jul 27 19:59:24.261982 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:24.261952    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bc7c676d4-grxp4_85e7c8a4-10bc-4672-bd7a-ddb0fbfc34fd/registry/0.log"
Jul 27 19:59:24.343728 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:24.343700    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xzcw7_9f4a232b-038d-4339-b4c6-47d834944aab/node-ca/0.log"
Jul 27 19:59:25.514510 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:25.514479    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-88vhs_09542220-f6ff-433a-b919-033b029df572/kube-auth-proxy/0.log"
Jul 27 19:59:26.584234 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:26.584205    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nbbkc_6e4a0890-24e4-4ffb-9e1d-0cccf1aa29ff/serve-healthcheck-canary/0.log"
Jul 27 19:59:27.133273 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:27.133239    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46lcw_a932cf25-2c36-4617-8d38-1bf360feab23/kube-rbac-proxy/0.log"
Jul 27 19:59:27.160627 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:27.160598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46lcw_a932cf25-2c36-4617-8d38-1bf360feab23/exporter/0.log"
Jul 27 19:59:27.188114 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:27.188090    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-46lcw_a932cf25-2c36-4617-8d38-1bf360feab23/extractor/0.log"
Jul 27 19:59:27.938819 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:27.938790    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk"
Jul 27 19:59:27.956885 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:27.956824    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hwxjc/perf-node-gather-daemonset-2vntk" podStartSLOduration=6.956807071 podStartE2EDuration="6.956807071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:59:21.9502543 +0000 UTC m=+3244.146223388" watchObservedRunningTime="2026-07-27 19:59:27.956807071 +0000 UTC m=+3250.152776158"
Jul 27 19:59:30.180336 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:30.180303    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-l8c4h_cbbd8b34-591f-40e8-a7cb-be09fc0214b9/server/0.log"
Jul 27 19:59:30.416470 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:30.416398    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-mlm9z_15cd3c92-47d6-400e-93b0-641893211c00/manager/0.log"
Jul 27 19:59:30.483981 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:30.483955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9459789d9-mlm9z_15cd3c92-47d6-400e-93b0-641893211c00/copy-manifests/0.log"
Jul 27 19:59:31.709373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:31.709343    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-88vhs_09542220-f6ff-433a-b919-033b029df572/kube-auth-proxy/0.log"
Jul 27 19:59:31.903794 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:31.903715    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6898ff9d7-pggld_79723fa8-2d51-4c17-a433-080754fe065b/manager/0.log"
Jul 27 19:59:33.288373 ip-10-0-132-61 kubenswrapper[2558]: I0727 19:59:33.288343    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd59b47cf-88vhs_09542220-f6ff-433a-b919-033b029df572/kube-auth-proxy/0.log"