Jul 16 09:05:01.048568 ip-10-0-137-79 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.499286    2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503214    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503227    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503231    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503234    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503238    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503241    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503244    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.636163 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503246    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.578938 ip-10-0-137-79 systemd[1]: Started Kubernetes Kubelet.
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503249    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503251    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503254    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503256    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503259    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503278    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503284    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503287    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503290    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503293    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503295    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503298    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503300    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503303    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503305    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503308    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503311    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503313    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.639028 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503316    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503319    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503322    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503325    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503327    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503331    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503333    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503336    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503338    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503341    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503343    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503346    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503348    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503350    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503353    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503355    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503358    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503360    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503363    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503366    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503369    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.654008 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503371    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503374    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503376    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503380    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503384    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503387    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503391    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503394    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503397    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503400    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503402    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503405    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503408    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503410    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503413    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503415    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503418    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503420    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503423    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503427    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.665605 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503429    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503432    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503435    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503437    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503439    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503442    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503444    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503446    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503449    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503452    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503455    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503457    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503460    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503463    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503465    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503468    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503470    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503473    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503476    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503480    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.809151 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503482    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503485    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503487    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503490    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503492    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503494    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503497    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503500    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503502    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503504    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503509    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.503512    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504174    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504180    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504183    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504186    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504189    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504192    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504194    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504197    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.810300 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504199    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504202    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504204    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504207    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504209    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504212    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504214    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504217    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504219    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504222    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504227    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504232    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504234    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504237    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504239    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504242    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504244    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504247    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504249    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504252    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.810963 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504254    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504256    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504259    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504262    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504281    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504284    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504287    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504289    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504292    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504295    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504297    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504300    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504303    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504305    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504308    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504310    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504312    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504315    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504317    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504320    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.811801 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504324    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504326    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504329    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504331    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504334    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504337    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504339    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504342    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504345    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504347    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504350    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504352    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504355    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504357    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504359    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504362    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504365    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504369    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504371    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.812455 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504373    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504376    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504378    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504380    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504383    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504385    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504388    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504390    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504393    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504395    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504400    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504403    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504407    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504410    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504413    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504415    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504422    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504425    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504427    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.813065 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504430    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504432    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504434    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504437    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504439    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504442    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504444    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504447    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504449    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504451    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504454    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504457    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.504461    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506123    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506133    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506137    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506140    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506143    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506146    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506148    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.813707 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506152    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506155    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506161    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506163    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506166    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506169    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506172    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506174    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506177    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506184    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506188    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506192    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506195    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506198    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506201    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506206    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506210    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506212    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.814366 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506215    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506218    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506221    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506224    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506226    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506231    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506235    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506238    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506240    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506246    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506248    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506251    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506254    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506256    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506259    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506262    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506283    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506287    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506289    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506292    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.814989 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506295    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506297    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506303    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506307    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506310    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506312    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506315    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506318    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506320    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506323    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506325    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506328    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506333    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506336    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506341    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506344    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506346    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506349    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506353    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506355    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.815629 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506358    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506361    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506363    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506366    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506369    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506373    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506379    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506382    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506385    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506388    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506392    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506394    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506397    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506399    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506402    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506406    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506409    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506414    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506417    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506419    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.816214 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506422    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506424    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506427    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506430    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506432    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506434    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506437    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506439    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506442    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506444    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506450    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506453    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506456    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.506459    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507250    2550 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507282    2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507293    2550 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507304    2550 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507308    2550 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507311    2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507315    2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 09:05:01.816853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507320    2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507323    2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507327    2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507330    2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507333    2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507336    2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507339    2550 flags.go:64] FLAG: --cgroup-root=""
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507343    2550 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507346    2550 flags.go:64] FLAG: --client-ca-file=""
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507348    2550 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507351    2550 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507357    2550 flags.go:64] FLAG: --cluster-domain=""
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507359    2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507363    2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507366    2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507369    2550 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507373    2550 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507376    2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507380    2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507383    2550 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507386    2550 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507389    2550 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507391    2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507395    2550 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 09:05:01.817480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507398    2550 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507403    2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507406    2550 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507408    2550 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507411    2550 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507417    2550 flags.go:64] FLAG: --enable-server="true"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507419    2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507424    2550 flags.go:64] FLAG: --event-burst="100"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507427    2550 flags.go:64] FLAG: --event-qps="50"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507429    2550 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507432    2550 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507435    2550 flags.go:64] FLAG: --eviction-hard=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507439    2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507442    2550 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507446    2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507449    2550 flags.go:64] FLAG: --eviction-soft=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507451    2550 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507456    2550 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507459    2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507462    2550 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507465    2550 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507468    2550 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507471    2550 flags.go:64] FLAG: --feature-gates=""
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507479    2550 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507482    2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 09:05:01.818127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507485    2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507488    2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507492    2550 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507494    2550 flags.go:64] FLAG: --help="false"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507497    2550 flags.go:64] FLAG: --hostname-override="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507501    2550 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507503    2550 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507506    2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507510    2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507514    2550 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507517    2550 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507520    2550 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507524    2550 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507527    2550 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507529    2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507532    2550 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507535    2550 flags.go:64] FLAG: --kube-reserved=""
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507538    2550 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507541    2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507544    2550 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507547    2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507550    2550 flags.go:64] FLAG: --lock-file=""
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507553    2550 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507556    2550 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 09:05:01.818991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507560    2550 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507566    2550 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507568    2550 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507571    2550 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507574    2550 flags.go:64] FLAG: --logging-format="text"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507577    2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507580    2550 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507583    2550 flags.go:64] FLAG: --manifest-url=""
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507585    2550 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507590    2550 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507593    2550 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507597    2550 flags.go:64] FLAG: --max-pods="110"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507600    2550 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507602    2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507605    2550 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507608    2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507611    2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507614    2550 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507617    2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507626    2550 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507630    2550 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507633    2550 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507636    2550 flags.go:64] FLAG: --pod-cidr=""
Jul 16 09:05:01.819829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507639    2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507644    2550 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507646    2550 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507649    2550 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507652    2550 flags.go:64] FLAG: --port="10250"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507655    2550 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507658    2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03328dec80f1de685"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507661    2550 flags.go:64] FLAG: --qos-reserved=""
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507664    2550 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507668    2550 flags.go:64] FLAG: --register-node="true"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507672    2550 flags.go:64] FLAG: --register-with-taints=""
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507675    2550 flags.go:64] FLAG: --registry-burst="10"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507678    2550 flags.go:64] FLAG: --registry-qps="5"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507682    2550 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507684    2550 flags.go:64] FLAG: --reserved-memory=""
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507688    2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507691    2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507694    2550 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507697    2550 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507699    2550 flags.go:64] FLAG: --runonce="false"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507702    2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507705    2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507708    2550 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507711    2550 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507714    2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507717    2550 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 09:05:01.823014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507719    2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507722    2550 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507725    2550 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507728    2550 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507732    2550 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507735    2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507738    2550 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507740    2550 flags.go:64] FLAG: --system-cgroups=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507743    2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507748    2550 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507751    2550 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507753    2550 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507759    2550 flags.go:64] FLAG: --tls-min-version=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507762    2550 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507764    2550 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507768    2550 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507771    2550 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507774    2550 flags.go:64] FLAG: --v="2"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507778    2550 flags.go:64] FLAG: --version="false"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507782    2550 flags.go:64] FLAG: --vmodule=""
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507786    2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.507789    2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507927    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507931    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.823885 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507934    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507937    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507940    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507943    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507945    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507948    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507950    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507952    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507955    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507959    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507961    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507964    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507968    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507971    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507973    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507976    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507978    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507981    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507983    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507986    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.830704 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507988    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507990    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507993    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507996    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.507999    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508002    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508004    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508007    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508010    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508013    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508015    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508018    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508020    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508023    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508025    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508027    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508030    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508032    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508035    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508037    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.831550 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508040    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508042    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508044    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508047    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508050    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508053    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508055    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508058    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508061    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508063    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508065    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508068    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508070    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508073    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508075    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508079    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508081    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508084    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508086    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.832185 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508090    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508093    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508096    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508099    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508102    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508105    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508108    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508110    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508113    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508116    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508118    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508121    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508124    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508126    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508129    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508132    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508135    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508139    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508141    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.832841 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508144    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508147    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508150    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508154    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508156    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508159    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508162    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508164    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508167    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508172    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508175    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508178    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508180    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508183    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508186    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508188    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508190    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508193    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.833479 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.508196    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.508204    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.515374    2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.515391    2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.515413    2550 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.515422    2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515478    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515483    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515487    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515490    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515493    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515496    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515499    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515505    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515508    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.834152 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515511    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515514    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515517    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515520    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515524    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515528    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515531    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515534    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515538    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515541    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515544    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515547    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515550    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515552    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515555    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515557    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515560    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515563    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515565    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515568    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.901137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515572    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515575    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515578    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515580    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515583    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515585    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515588    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515590    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515593    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515595    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515599    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515602    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515604    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515607    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515609    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515612    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515614    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515617    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515620    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515622    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.902059 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515626    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515629    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515631    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515634    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515636    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515639    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515642    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515644    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515647    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515649    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515652    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515655    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515658    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515661    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515665    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515668    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515671    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515674    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515676    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.902686 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515679    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515683    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515687    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515692    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515694    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515697    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515700    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515702    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515705    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515707    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515710    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515712    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515714    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515718    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515720    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515723    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515725    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515728    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515731    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515733    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.903529 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515735    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515738    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515741    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515743    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515745    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515748    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515751    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515754    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515756    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515759    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515761    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.515766    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515885    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515891    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515894    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 09:05:01.904158 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515897    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515902    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515905    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515908    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515911    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515913    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515916    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515919    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515922    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515925    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515928    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515931    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515934    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515936    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515939    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515941    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515944    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515946    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515949    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 09:05:01.904793 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515953    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515957    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515960    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515962    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515965    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515967    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515972    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515974    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515978    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515980    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515984    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515987    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515989    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515992    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515996    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.515998    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516001    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516004    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516006    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 09:05:01.905640 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516008    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516011    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516013    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516016    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516021    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516023    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516026    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516028    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516031    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516034    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516036    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516038    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516041    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516043    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516046    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516048    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516051    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516053    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516055    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516058    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 09:05:01.906290 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516061    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516064    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516066    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516068    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516071    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516073    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516075    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516080    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516082    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516085    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516087    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516090    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516093    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516095    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516098    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516100    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516104    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516107    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516110    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 09:05:01.906908 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516112    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516116    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516119    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516122    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516125    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516128    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516130    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516133    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516136    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516139    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516141    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516144    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516146    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516148    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516151    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516154    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516156    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516159    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 09:05:01.907536 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:01.516162    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.516166    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.516303    2550 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.519553    2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.521187    2550 server.go:1019] "Starting client certificate rotation"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.521293    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.521320    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.524213    2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.526430    2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.540635    2550 log.go:25] "Validated CRI v1 runtime API"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.543215    2550 log.go:25] "Validated CRI v1 image API"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.545318    2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 09:05:01.908167 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.549672    2550 fs.go:135] Filesystem UUIDs: map[28dbc154-fe79-4475-934f-eac5402b1996:/dev/nvme0n1p3 31eeea39-d4fa-4eca-9b35-345cb70282e2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 16 09:05:01.908590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.549694    2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 09:05:01.908590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.552654    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.556516    2550 manager.go:216] Machine: {Timestamp:2026-07-16 09:05:01.555097629 +0000 UTC m=+0.374457698 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200550 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec259f4d7c11dedbb6adaae59be97694 SystemUUID:ec259f4d-7c11-dedb-b6ad-aae59be97694 BootID:efab0d19-db86-4773-90b7-58e242c64bdf Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:e5:e0:6c:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:e5:e0:6c:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:53:0c:00:6b:22 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.556618    2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.556704    2550 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.560111    2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.560143    2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.561002    2550 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.561012    2550 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.561020    2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.561031    2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.562745    2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566160    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566283    2550 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566311    2550 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566320    2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566330    2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566340    2550 kubelet.go:398] "Adding apiserver pod source"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566348    2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 09:05:01.909012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566731    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.566752    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.569156    2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.570829    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zm46g"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.571668    2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.571695    2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572524    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572537    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572543    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572548    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572556    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572561    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572568    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572573    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572579    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572584    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572592    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.572599    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.573493    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.573499    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.576102    2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.576139    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.576176    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.577975    2550 server.go:1268] "Started kubelet"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.578041    2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.578700    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zm46g"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.579148    2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.579220    2550 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.580206    2550 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.581664    2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.583194    2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.584711    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-79.ec2.internal.18c2b9cf1c626a3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-79.ec2.internal,UID:ip-10-0-137-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-79.ec2.internal,},FirstTimestamp:2026-07-16 09:05:01.577718334 +0000 UTC m=+0.397078404,LastTimestamp:2026-07-16 09:05:01.577718334 +0000 UTC m=+0.397078404,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-79.ec2.internal,}"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.587209    2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.587356    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.587436    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588074    2550 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588085    2550 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588213    2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588259    2550 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 09:05:01.912839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588263    2550 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588786    2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588800    2550 factory.go:55] Registering systemd factory
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.588809    2550 factory.go:223] Registration of the systemd container factory successfully
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.589093    2550 factory.go:153] Registering CRI-O factory
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.589106    2550 factory.go:223] Registration of the crio container factory successfully
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.589128    2550 factory.go:103] Registering Raw factory
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.589143    2550 manager.go:1196] Started watching for new ooms in manager
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.589978    2550 manager.go:349] Starting recovery of all containers
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.598083    2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.600286    2550 manager.go:354] Recovery completed
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.600613    2550 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-79.ec2.internal\" not found" node="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.606513    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608372    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608398    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608408    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608924    2550 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608932    2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608949    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.608934    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.609703    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.609724    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.609733    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.610122    2550 policy_none.go:49] "None policy: Start"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.610134    2550 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.610143    2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.611311    2550 policy_none.go:47] "Start"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.686932    2550 manager.go:337] "Starting Device Plugin manager"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.687139    2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687153    2550 server.go:87] "Starting device plugin registration server"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687414    2550 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687426    2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687501    2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687572    2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.687585    2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.688558    2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.688604    2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.731460    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.732614    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.732657    2550 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.732684    2550 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.732725    2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.735048    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.787890    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.788872    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.788900    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.788917    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.788940    2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.799750    2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.913981 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.799772    2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-79.ec2.internal\": node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.814246    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.833302    2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"]
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.833389    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.834416    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.834452    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.834468    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.835864    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.835973    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836000    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836630    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836654    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836668    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836669    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836764    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.836990    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.838484    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.838517    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.839762    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.839788    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.839800    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeHasSufficientPID"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.914761    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.971163    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-79.ec2.internal\" not found" node="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:01.978809 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:01.975824    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-79.ec2.internal\" not found" node="ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.058518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.990004    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb2f2f9ee8258d42945cd1eb17f2050c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-79.ec2.internal\" (UID: \"fb2f2f9ee8258d42945cd1eb17f2050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.058518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.990031    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.058518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:01.990047    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.058518 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:02.015695    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090241    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090281    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090300    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb2f2f9ee8258d42945cd1eb17f2050c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-79.ec2.internal\" (UID: \"fb2f2f9ee8258d42945cd1eb17f2050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090339    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb2f2f9ee8258d42945cd1eb17f2050c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-79.ec2.internal\" (UID: \"fb2f2f9ee8258d42945cd1eb17f2050c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090380    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.090402    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb5e10e9a5b0d3e70008ee6ce282ea9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal\" (UID: \"ecb5e10e9a5b0d3e70008ee6ce282ea9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.123823 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:02.116558    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:02.279318 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:02.217013    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:02.279318 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.273202    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.279318 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:02.279319    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:02.361679 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:02.318069    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:03.561407 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:03.543907    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:03.660896 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:03.644440    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:03.660896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.645510    2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 09:05:03.660896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.645641    2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 09:05:03.660896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.645666    2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 09:05:03.762718 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.709416    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 09:00:02 +0000 UTC" deadline="2028-01-11 08:24:12.993919862 +0000 UTC"
Jul 16 09:05:03.762718 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.709460    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13055h19m9.284462392s"
Jul 16 09:05:03.762718 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:03.745148    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:03.883092 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:03.805845    2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:03.883092 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:03.846136    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:03.981520 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:03.946522    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:04.061437 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.047041    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-79.ec2.internal\" not found"
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.143057    2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:04.147210    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb5e10e9a5b0d3e70008ee6ce282ea9.slice/crio-b34a9aba44734ea40ecb41d746cb124ed8bb3e4bc39100a368d46e21bb2513e8 WatchSource:0}: Error finding container b34a9aba44734ea40ecb41d746cb124ed8bb3e4bc39100a368d46e21bb2513e8: Status 404 returned error can't find the container with id b34a9aba44734ea40ecb41d746cb124ed8bb3e4bc39100a368d46e21bb2513e8
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:04.147440    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2f2f9ee8258d42945cd1eb17f2050c.slice/crio-2b14bd903583be12ae9cc503ec9b4f764e28d868f4c17d0d21345428b1aead69 WatchSource:0}: Error finding container 2b14bd903583be12ae9cc503ec9b4f764e28d868f4c17d0d21345428b1aead69: Status 404 returned error can't find the container with id 2b14bd903583be12ae9cc503ec9b4f764e28d868f4c17d0d21345428b1aead69
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.151202    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.215240    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.226554    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 09:05:04.231417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.227837    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal"
Jul 16 09:05:04.240544 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.240527    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 09:05:04.551295 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.551211    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:04.693284 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.693210    2550 apiserver.go:52] "Watching apiserver"
Jul 16 09:05:04.700017 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.699984    2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 09:05:04.703096 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.703051    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hbkbp","openshift-multus/multus-hmgjn","openshift-cluster-node-tuning-operator/tuned-94h2h","openshift-dns/node-resolver-hvqdv","openshift-multus/network-metrics-daemon-9hhgz","openshift-network-diagnostics/network-check-target-wwbgr","openshift-network-operator/iptables-alerter-x57jh","openshift-ovn-kubernetes/ovnkube-node-4jx6b","kube-system/global-pull-secret-syncer-hrq68","kube-system/konnectivity-agent-w8b8c","kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69","openshift-image-registry/node-ca-gdsjt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal"]
Jul 16 09:05:04.705629 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.705603    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.708312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.707967    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 09:05:04.708312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.707997    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.708312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.708012    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.708312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.707975    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6zcfz\""
Jul 16 09:05:04.708312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.708182    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.710133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710109    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.710431 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710381    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 09:05:04.710775 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710757    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.710857 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710773    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fqv4x\""
Jul 16 09:05:04.710857 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710784    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 09:05:04.710857 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.710795    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.712616    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.713341    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.713683    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.714918    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.714955    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64pjf\""
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.715093    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 09:05:04.715238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.715188    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.715739 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.715260    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.715739 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.715350    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6pskb\""
Jul 16 09:05:04.716573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.716552    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.716734 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.716693    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:04.719924 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.719802    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:04.719924 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.719887    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:04.722126 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.722106    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.723870 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.723854    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kkt4j\""
Jul 16 09:05:04.724155 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724108    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 09:05:04.724311 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724297    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 09:05:04.724424 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724392    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.724522 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724502    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-system-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724580 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724562    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-multus\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724614 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724595    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-conf-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724651 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724621    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-multus-certs\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724681 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724646    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.724740 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724670    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-socket-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.724797 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724737    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-registration-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.724797 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724766    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-etc-selinux\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.724797 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724792    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-sys-fs\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.724945 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724813    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-kubelet\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724945 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724833    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-etc-kubernetes\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.724945 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724891    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-tmp\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.724945 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724906    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 09:05:04.724945 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724925    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysconfig\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.724975    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4967901f-de92-48f8-a7fb-b4f5bc3ba144-serviceca\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725002    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bchjr\" (UniqueName: \"kubernetes.io/projected/4967901f-de92-48f8-a7fb-b4f5bc3ba144-kube-api-access-bchjr\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725045    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfdx2\" (UniqueName: \"kubernetes.io/projected/ec102fe0-31ab-4f36-bd89-479b15643e15-kube-api-access-rfdx2\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725070    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-device-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725092    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-cnibin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725134    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-os-release\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725171    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-daemon-config\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725216    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-modprobe-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725236    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-sys\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725273    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfvr9\" (UniqueName: \"kubernetes.io/projected/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kube-api-access-sfvr9\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725317    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-k8s-cni-cncf-io\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725358    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725386    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-conf\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725415    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-var-lib-kubelet\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725436    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4967901f-de92-48f8-a7fb-b4f5bc3ba144-host\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725478    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-cni-binary-copy\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725579    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-socket-dir-parent\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.725639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725607    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-bin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725628    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-hostroot\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725671    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-systemd\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725693    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-run\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725768    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z94t\" (UniqueName: \"kubernetes.io/projected/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-kube-api-access-4z94t\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725794    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-kubernetes\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725815    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-lib-modules\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725835    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-host\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725879    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725905    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-netns\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725946    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtz8j\" (UniqueName: \"kubernetes.io/projected/ccc440bf-6733-4a53-999f-cb09ce38c661-kube-api-access-vtz8j\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725969    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-tuned\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.726046 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.725989    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.726538 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.726478    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m275q\""
Jul 16 09:05:04.726751 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.726728    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.726845 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.726766    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.726845 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.726827    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:04.726981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.726965    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 09:05:04.727029 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.726970    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.729567 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.729543    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.731449 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.731417    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.732173 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.732156    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 09:05:04.732259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.732211    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 09:05:04.732474 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.732457    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n5x7r\""
Jul 16 09:05:04.734317 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734298    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.734317 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734304    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 09:05:04.734774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734346    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 09:05:04.734774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734396    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 09:05:04.734774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734443    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-792zk\""
Jul 16 09:05:04.734774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734452    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.734774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.734478    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 09:05:04.735610 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.735589    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.738113 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.738085    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 09:05:04.738483 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.738467    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 09:05:04.738557 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.738535    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-94rz7\""
Jul 16 09:05:04.750963 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.750939    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrqmt"
Jul 16 09:05:04.759314 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.759144    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jrqmt"
Jul 16 09:05:04.815639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.815561    2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 09:05:04.826957 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.826923    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-bin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.826971    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-run\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827015    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-lib-modules\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827035    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-host\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827051    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-bin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827064    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddffdff-7b8e-46b4-8110-98e705850c3c-host-slash\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827085    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-netns\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827127 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827122    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-host\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827151    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-run\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827152    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-netd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827198    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827216    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-lib-modules\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827227    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-netns\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827252    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtz8j\" (UniqueName: \"kubernetes.io/projected/ccc440bf-6733-4a53-999f-cb09ce38c661-kube-api-access-vtz8j\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827271    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-tuned\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827288    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-etc-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827304    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-bin\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827318    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-multus\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827332    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-conf-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827349    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827365    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827373    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827380    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-env-overrides\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827398    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cf97955-528c-4fea-a719-811578fc6557-ovn-node-metrics-cert\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.827451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827432    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-netns\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827437    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-cni-multus\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827457    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-conf-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827724    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jczgm\" (UniqueName: \"kubernetes.io/projected/6cf97955-528c-4fea-a719-811578fc6557-kube-api-access-jczgm\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827751    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb741ad-738b-4c37-91ca-9f4e7cea123e-tmp-dir\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827778    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827793    2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827802    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-socket-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827886    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827898    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-sys-fs\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827936    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-kubelet\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.827960    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bchjr\" (UniqueName: \"kubernetes.io/projected/4967901f-de92-48f8-a7fb-b4f5bc3ba144-kube-api-access-bchjr\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828019    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-var-lib-kubelet\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828055    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfdx2\" (UniqueName: \"kubernetes.io/projected/ec102fe0-31ab-4f36-bd89-479b15643e15-kube-api-access-rfdx2\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828094    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-script-lib\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828274    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-sys-fs\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.828291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828017    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-socket-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828349    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4967901f-de92-48f8-a7fb-b4f5bc3ba144-serviceca\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828378    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-systemd-units\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828436    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-systemd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828469    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-os-release\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828492    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-daemon-config\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828514    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-sys\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828577    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828603    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfvr9\" (UniqueName: \"kubernetes.io/projected/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kube-api-access-sfvr9\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828661    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-k8s-cni-cncf-io\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828685    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-conf\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828736    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4967901f-de92-48f8-a7fb-b4f5bc3ba144-host\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828764    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ddffdff-7b8e-46b4-8110-98e705850c3c-iptables-alerter-script\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828841    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4967901f-de92-48f8-a7fb-b4f5bc3ba144-host\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828874    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-system-cni-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828900    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-cni-binary-copy\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828922    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-hostroot\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828945    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-systemd\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828969    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z94t\" (UniqueName: \"kubernetes.io/projected/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-kube-api-access-4z94t\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.828995    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cnibin\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829021    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-konnectivity-ca\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829046    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-slash\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829074    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-var-lib-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829100    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-kubernetes\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829103    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-daemon-config\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829165    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-conf\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829172    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829200    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829225    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-kubelet-config\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829250    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-dbus\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829273    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-system-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829319    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-k8s-cni-cncf-io\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829336    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-systemd\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829341    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-multus-certs\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.829768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829345    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-kubernetes\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829370    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-host-run-multus-certs\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829413    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-system-cni-dir\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.829418    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829469    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-os-release\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.829496    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:05.329463261 +0000 UTC m=+3.023390681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829539    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829566    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-agent-certs\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829599    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-hostroot\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829616    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-sys\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829657    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-node-log\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829682    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-log-socket\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829741    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fb741ad-738b-4c37-91ca-9f4e7cea123e-hosts-file\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829768    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-registration-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829798    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-etc-selinux\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829834    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-registration-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829851    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4967901f-de92-48f8-a7fb-b4f5bc3ba144-serviceca\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.830562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829871    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-etc-kubernetes\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829913    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-etc-kubernetes\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829915    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-etc-selinux\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829926    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-tmp\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829929    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccc440bf-6733-4a53-999f-cb09ce38c661-cni-binary-copy\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.829959    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830025    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84vvv\" (UniqueName: \"kubernetes.io/projected/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-kube-api-access-84vvv\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830058    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-kubelet\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830084    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysconfig\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830125    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysconfig\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830132    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgt6s\" (UniqueName: \"kubernetes.io/projected/3ddffdff-7b8e-46b4-8110-98e705850c3c-kube-api-access-vgt6s\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830173    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-os-release\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830198    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-ovn\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830235    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-device-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830256    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-cnibin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830277    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-modprobe-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830298    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.831345 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830299    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-device-dir\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830317    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-cnibin\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830331    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830361    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-config\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830382    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-modprobe-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830386    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830409    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-var-lib-kubelet\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830435    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830446    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-var-lib-kubelet\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830461    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npngl\" (UniqueName: \"kubernetes.io/projected/7fb741ad-738b-4c37-91ca-9f4e7cea123e-kube-api-access-npngl\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830466    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-sysctl-d\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830488    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-socket-dir-parent\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.830574    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccc440bf-6733-4a53-999f-cb09ce38c661-multus-socket-dir-parent\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.832118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.831772    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-etc-tuned\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.832656 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.832587    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-tmp\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.835669 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.835611    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bchjr\" (UniqueName: \"kubernetes.io/projected/4967901f-de92-48f8-a7fb-b4f5bc3ba144-kube-api-access-bchjr\") pod \"node-ca-gdsjt\" (UID: \"4967901f-de92-48f8-a7fb-b4f5bc3ba144\") " pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:04.835809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.835788    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtz8j\" (UniqueName: \"kubernetes.io/projected/ccc440bf-6733-4a53-999f-cb09ce38c661-kube-api-access-vtz8j\") pod \"multus-hmgjn\" (UID: \"ccc440bf-6733-4a53-999f-cb09ce38c661\") " pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:04.837251 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.837219    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfdx2\" (UniqueName: \"kubernetes.io/projected/ec102fe0-31ab-4f36-bd89-479b15643e15-kube-api-access-rfdx2\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:04.838735 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.838712    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z94t\" (UniqueName: \"kubernetes.io/projected/6912b4e7-3f36-46ef-a1cf-c917d06c33ff-kube-api-access-4z94t\") pod \"tuned-94h2h\" (UID: \"6912b4e7-3f36-46ef-a1cf-c917d06c33ff\") " pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:04.839132 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.839092    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfvr9\" (UniqueName: \"kubernetes.io/projected/53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b-kube-api-access-sfvr9\") pod \"aws-ebs-csi-driver-node-btx69\" (UID: \"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:04.863041 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.862979    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal" event={"ID":"ecb5e10e9a5b0d3e70008ee6ce282ea9","Type":"ContainerStarted","Data":"b34a9aba44734ea40ecb41d746cb124ed8bb3e4bc39100a368d46e21bb2513e8"}
Jul 16 09:05:04.866095 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.866062    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal" event={"ID":"fb2f2f9ee8258d42945cd1eb17f2050c","Type":"ContainerStarted","Data":"2b14bd903583be12ae9cc503ec9b4f764e28d868f4c17d0d21345428b1aead69"}
Jul 16 09:05:04.931205 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931169    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-script-lib\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931205 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931216    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-systemd-units\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931241    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-systemd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931268    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931295    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ddffdff-7b8e-46b4-8110-98e705850c3c-iptables-alerter-script\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931317    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-system-cni-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931344    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cnibin\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931365    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-konnectivity-ca\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931392    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-slash\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931414    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-var-lib-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931438    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931474    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-kubelet-config\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931505    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-dbus\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931529    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931552    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-agent-certs\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931609    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-node-log\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931631    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-log-socket\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931657    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fb741ad-738b-4c37-91ca-9f4e7cea123e-hosts-file\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931691    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931736    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84vvv\" (UniqueName: \"kubernetes.io/projected/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-kube-api-access-84vvv\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931768    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-kubelet\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931796    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgt6s\" (UniqueName: \"kubernetes.io/projected/3ddffdff-7b8e-46b4-8110-98e705850c3c-kube-api-access-vgt6s\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931817    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-os-release\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.931837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931840    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-ovn\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.932489 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931865    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.932489 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.931896    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.933231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933032    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-config\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.933231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933101    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.933231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933159    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npngl\" (UniqueName: \"kubernetes.io/projected/7fb741ad-738b-4c37-91ca-9f4e7cea123e-kube-api-access-npngl\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.933231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933202    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddffdff-7b8e-46b4-8110-98e705850c3c-host-slash\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.933503 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933272    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-netns\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.933503 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.933382    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-netns\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.933598 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.933517    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:04.933598 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.933586    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:05.433566804 +0000 UTC m=+3.127494226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:04.934187 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934158    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-dbus\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.934291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934235    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-system-cni-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.934447 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934429    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-node-log\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.934527 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934493    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-log-socket\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.934635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934551    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7fb741ad-738b-4c37-91ca-9f4e7cea123e-hosts-file\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.934736 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934689    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.934973    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-script-lib\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.935006    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-kubelet\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.935056    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-systemd-units\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.935060    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-ovn\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.935130    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-systemd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.935564    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936086    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3ddffdff-7b8e-46b4-8110-98e705850c3c-iptables-alerter-script\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936091    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-ovnkube-config\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936209    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ddffdff-7b8e-46b4-8110-98e705850c3c-host-slash\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936222    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-os-release\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936914    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.936988    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937048    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-var-lib-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937118    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cnibin\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937679    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-konnectivity-ca\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937769    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-slash\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.938754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937836    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d27c408d-862b-4972-8c5c-6290c2b725f1-kubelet-config\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937888    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-run-ovn-kubernetes\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937927    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-netd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937964    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-etc-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.937988    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-bin\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938023    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938087    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938126    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-env-overrides\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938158    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cf97955-528c-4fea-a719-811578fc6557-ovn-node-metrics-cert\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938183    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jczgm\" (UniqueName: \"kubernetes.io/projected/6cf97955-528c-4fea-a719-811578fc6557-kube-api-access-jczgm\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938203    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-run-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938212    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb741ad-738b-4c37-91ca-9f4e7cea123e-tmp-dir\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938295    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-bin\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938500    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fb741ad-738b-4c37-91ca-9f4e7cea123e-tmp-dir\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938094    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-etc-openvswitch\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938574    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6cf97955-528c-4fea-a719-811578fc6557-host-cni-netd\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.939573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.938746    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.941070 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.940714    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:04.941070 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.940741    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:04.941070 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.940740    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6cf97955-528c-4fea-a719-811578fc6557-env-overrides\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.941070 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.940762    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:04.941070 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:04.940864    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:05.440839368 +0000 UTC m=+3.134766808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:04.942531 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.942489    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985-agent-certs\") pod \"konnectivity-agent-w8b8c\" (UID: \"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985\") " pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:04.943574 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.943542    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgt6s\" (UniqueName: \"kubernetes.io/projected/3ddffdff-7b8e-46b4-8110-98e705850c3c-kube-api-access-vgt6s\") pod \"iptables-alerter-x57jh\" (UID: \"3ddffdff-7b8e-46b4-8110-98e705850c3c\") " pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:04.945664 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.945613    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84vvv\" (UniqueName: \"kubernetes.io/projected/ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b-kube-api-access-84vvv\") pod \"multus-additional-cni-plugins-hbkbp\" (UID: \"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b\") " pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:04.947001 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.946818    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cf97955-528c-4fea-a719-811578fc6557-ovn-node-metrics-cert\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:04.947001 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.946959    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npngl\" (UniqueName: \"kubernetes.io/projected/7fb741ad-738b-4c37-91ca-9f4e7cea123e-kube-api-access-npngl\") pod \"node-resolver-hvqdv\" (UID: \"7fb741ad-738b-4c37-91ca-9f4e7cea123e\") " pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:04.950494 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:04.950449    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jczgm\" (UniqueName: \"kubernetes.io/projected/6cf97955-528c-4fea-a719-811578fc6557-kube-api-access-jczgm\") pod \"ovnkube-node-4jx6b\" (UID: \"6cf97955-528c-4fea-a719-811578fc6557\") " pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:05.020758 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.020721    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69"
Jul 16 09:05:05.029254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.029223    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmgjn"
Jul 16 09:05:05.032736 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.032676    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c590a1_f7bb_43dc_8aa7_f1c1e3cb936b.slice/crio-1d3aadb7824eca53be1e2870d54123455a0bbafb8976511dfa70ed9234568b17 WatchSource:0}: Error finding container 1d3aadb7824eca53be1e2870d54123455a0bbafb8976511dfa70ed9234568b17: Status 404 returned error can't find the container with id 1d3aadb7824eca53be1e2870d54123455a0bbafb8976511dfa70ed9234568b17
Jul 16 09:05:05.038660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.038636    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-94h2h"
Jul 16 09:05:05.039547 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.039318    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc440bf_6733_4a53_999f_cb09ce38c661.slice/crio-fad800032ddc09cd41c1c4eb30810ddc8c30dc67fd2ac4739fc55b4300ec4fb3 WatchSource:0}: Error finding container fad800032ddc09cd41c1c4eb30810ddc8c30dc67fd2ac4739fc55b4300ec4fb3: Status 404 returned error can't find the container with id fad800032ddc09cd41c1c4eb30810ddc8c30dc67fd2ac4739fc55b4300ec4fb3
Jul 16 09:05:05.045812 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.045765    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gdsjt"
Jul 16 09:05:05.049021 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.048993    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6912b4e7_3f36_46ef_a1cf_c917d06c33ff.slice/crio-1dbea438f6013a09e0cd1ec8ff303775e9fca3be5d453e0596c76660e3f51bfa WatchSource:0}: Error finding container 1dbea438f6013a09e0cd1ec8ff303775e9fca3be5d453e0596c76660e3f51bfa: Status 404 returned error can't find the container with id 1dbea438f6013a09e0cd1ec8ff303775e9fca3be5d453e0596c76660e3f51bfa
Jul 16 09:05:05.053929 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.053907    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hbkbp"
Jul 16 09:05:05.055307 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.055281    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4967901f_de92_48f8_a7fb_b4f5bc3ba144.slice/crio-a0e7d93e60b2173ae20da91e17259d6e75896ce3e7c925263648bddae21ed051 WatchSource:0}: Error finding container a0e7d93e60b2173ae20da91e17259d6e75896ce3e7c925263648bddae21ed051: Status 404 returned error can't find the container with id a0e7d93e60b2173ae20da91e17259d6e75896ce3e7c925263648bddae21ed051
Jul 16 09:05:05.064813 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.064790    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x57jh"
Jul 16 09:05:05.065490 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.065463    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb5c6f4_253a_4ffb_b78b_41cd09fceb3b.slice/crio-75691c297e93e7f4c5efbc73747e28726a155e529808992029df23b067d36288 WatchSource:0}: Error finding container 75691c297e93e7f4c5efbc73747e28726a155e529808992029df23b067d36288: Status 404 returned error can't find the container with id 75691c297e93e7f4c5efbc73747e28726a155e529808992029df23b067d36288
Jul 16 09:05:05.074508 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.074482    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:05.075867 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.075841    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddffdff_7b8e_46b4_8110_98e705850c3c.slice/crio-4a58f12adb3fc09182725ff1548bff31bb6d308bc65d98b842299108748c3799 WatchSource:0}: Error finding container 4a58f12adb3fc09182725ff1548bff31bb6d308bc65d98b842299108748c3799: Status 404 returned error can't find the container with id 4a58f12adb3fc09182725ff1548bff31bb6d308bc65d98b842299108748c3799
Jul 16 09:05:05.079012 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.078942    2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 09:05:05.084935 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.084909    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e4d02a_3dc6_48f2_b3cb_a9f60fd70985.slice/crio-abb24534f5ac906363912e9b73dc0129bdcb5d1dadb9324c57cf222826d3f12b WatchSource:0}: Error finding container abb24534f5ac906363912e9b73dc0129bdcb5d1dadb9324c57cf222826d3f12b: Status 404 returned error can't find the container with id abb24534f5ac906363912e9b73dc0129bdcb5d1dadb9324c57cf222826d3f12b
Jul 16 09:05:05.087091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.087054    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:05.095067 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.094793    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hvqdv"
Jul 16 09:05:05.097752 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.097723    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf97955_528c_4fea_a719_811578fc6557.slice/crio-7a5dbf91419497df1bef5921582b18c5f306024a8e0936ecef4d32f08cd5b882 WatchSource:0}: Error finding container 7a5dbf91419497df1bef5921582b18c5f306024a8e0936ecef4d32f08cd5b882: Status 404 returned error can't find the container with id 7a5dbf91419497df1bef5921582b18c5f306024a8e0936ecef4d32f08cd5b882
Jul 16 09:05:05.108431 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:05.108396    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb741ad_738b_4c37_91ca_9f4e7cea123e.slice/crio-9c9cc4cca95c10809c88a4e1f42a9afcec23876f77b2b939f92a3950ac6d61d5 WatchSource:0}: Error finding container 9c9cc4cca95c10809c88a4e1f42a9afcec23876f77b2b939f92a3950ac6d61d5: Status 404 returned error can't find the container with id 9c9cc4cca95c10809c88a4e1f42a9afcec23876f77b2b939f92a3950ac6d61d5
Jul 16 09:05:05.340546 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.340464    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:05.340696 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.340639    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:05.340793 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.340726    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:06.340691615 +0000 UTC m=+4.034619038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:05.441325 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.441290    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:05.441509 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.441370    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:05.441509 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441497    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:05.441621 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441519    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:05.441621 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441533    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:05.441621 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441493    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:05.441755 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441588    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:06.441571271 +0000 UTC m=+4.135498710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:05.441755 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.441663    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:06.441643892 +0000 UTC m=+4.135571316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:05.764735 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.764608    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 09:00:04 +0000 UTC" deadline="2028-01-27 10:07:03.513870815 +0000 UTC"
Jul 16 09:05:05.764735 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.764664    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13441h1m57.749210877s"
Jul 16 09:05:05.858584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.858551    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:05.859167 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:05.858685    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:05.868910 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.868867    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvqdv" event={"ID":"7fb741ad-738b-4c37-91ca-9f4e7cea123e","Type":"ContainerStarted","Data":"9c9cc4cca95c10809c88a4e1f42a9afcec23876f77b2b939f92a3950ac6d61d5"}
Jul 16 09:05:05.870096 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.870068    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"7a5dbf91419497df1bef5921582b18c5f306024a8e0936ecef4d32f08cd5b882"}
Jul 16 09:05:05.871316 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.871291    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94h2h" event={"ID":"6912b4e7-3f36-46ef-a1cf-c917d06c33ff","Type":"ContainerStarted","Data":"1dbea438f6013a09e0cd1ec8ff303775e9fca3be5d453e0596c76660e3f51bfa"}
Jul 16 09:05:05.872645 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.872620    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmgjn" event={"ID":"ccc440bf-6733-4a53-999f-cb09ce38c661","Type":"ContainerStarted","Data":"fad800032ddc09cd41c1c4eb30810ddc8c30dc67fd2ac4739fc55b4300ec4fb3"}
Jul 16 09:05:05.873811 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.873780    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8b8c" event={"ID":"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985","Type":"ContainerStarted","Data":"abb24534f5ac906363912e9b73dc0129bdcb5d1dadb9324c57cf222826d3f12b"}
Jul 16 09:05:05.876444 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.876417    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x57jh" event={"ID":"3ddffdff-7b8e-46b4-8110-98e705850c3c","Type":"ContainerStarted","Data":"4a58f12adb3fc09182725ff1548bff31bb6d308bc65d98b842299108748c3799"}
Jul 16 09:05:05.877596 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.877570    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerStarted","Data":"75691c297e93e7f4c5efbc73747e28726a155e529808992029df23b067d36288"}
Jul 16 09:05:05.878757 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.878732    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gdsjt" event={"ID":"4967901f-de92-48f8-a7fb-b4f5bc3ba144","Type":"ContainerStarted","Data":"a0e7d93e60b2173ae20da91e17259d6e75896ce3e7c925263648bddae21ed051"}
Jul 16 09:05:05.879949 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:05.879929    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69" event={"ID":"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b","Type":"ContainerStarted","Data":"1d3aadb7824eca53be1e2870d54123455a0bbafb8976511dfa70ed9234568b17"}
Jul 16 09:05:06.349100 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.348967    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:06.349286 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.349135    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:06.349286 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.349214    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:08.349192526 +0000 UTC m=+6.043119959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.450263    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.450344    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.450487    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.450551    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:08.450530728 +0000 UTC m=+6.144458165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.450986    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.451003    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.451016    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:06.451111 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.451075    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:08.451043367 +0000 UTC m=+6.144970788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:06.765742 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.765633    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 09:00:04 +0000 UTC" deadline="2028-03-19 03:01:34.079367138 +0000 UTC"
Jul 16 09:05:06.765742 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.765676    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14681h56m27.313695697s"
Jul 16 09:05:06.858687 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.858656    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:06.859163 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.858881    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:06.859163 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:06.858889    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:06.859163 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:06.858982    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:07.859076 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:07.858486    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:07.859076 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:07.858877    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:07.890414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:07.889659    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal" event={"ID":"fb2f2f9ee8258d42945cd1eb17f2050c","Type":"ContainerStarted","Data":"23edecef615884ad8d5dfdbbbeb5c7b34dff04552b75affb99ef06bbab3aa776"}
Jul 16 09:05:08.367002 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.366380    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:08.367002 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.366564    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:08.367002 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.366631    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:12.366611217 +0000 UTC m=+10.060538848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.467203    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.467271    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467405    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467429    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467457    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467470    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467481    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:12.467463402 +0000 UTC m=+10.161390825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:08.467816 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.467519    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:12.467504015 +0000 UTC m=+10.161431437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:08.862782 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.862688    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:08.863206 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.862823    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:08.863206 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.862833    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:08.863206 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:08.862915    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:08.895468 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.895399    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal" event={"ID":"ecb5e10e9a5b0d3e70008ee6ce282ea9","Type":"ContainerStarted","Data":"a127e6d4531a4d9c3233d0cb9842bb4484a32cb416ecbf16ffc39dfde0d38d97"}
Jul 16 09:05:08.910633 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:08.910485    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-79.ec2.internal" podStartSLOduration=4.910462234 podStartE2EDuration="4.910462234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:07.906923524 +0000 UTC m=+5.600850970" watchObservedRunningTime="2026-07-16 09:05:08.910462234 +0000 UTC m=+6.604389675"
Jul 16 09:05:09.859058 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:09.859030    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:09.859191 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:09.859157    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:09.899131 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:09.899092    2550 generic.go:356] "Generic (PLEG): container finished" podID="ecb5e10e9a5b0d3e70008ee6ce282ea9" containerID="a127e6d4531a4d9c3233d0cb9842bb4484a32cb416ecbf16ffc39dfde0d38d97" exitCode=0
Jul 16 09:05:09.899541 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:09.899149    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal" event={"ID":"ecb5e10e9a5b0d3e70008ee6ce282ea9","Type":"ContainerDied","Data":"a127e6d4531a4d9c3233d0cb9842bb4484a32cb416ecbf16ffc39dfde0d38d97"}
Jul 16 09:05:10.859841 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:10.859808    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:10.860004 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:10.859952    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:10.860312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:10.860294    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:10.860421 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:10.860394    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:11.858517 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:11.858482    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:11.858952 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:11.858624    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:12.401930 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:12.401890    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:12.402138 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.402117    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:12.402230 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.402191    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:20.402171296 +0000 UTC m=+18.096098719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:12.502385 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:12.502343    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:12.502572 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:12.502418    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:12.502628 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502567    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:12.502676 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502636    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:20.502616619 +0000 UTC m=+18.196544055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:12.502768 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502736    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:12.502768 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502751    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:12.502768 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502764    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:12.502913 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.502803    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:20.50279074 +0000 UTC m=+18.196718171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:12.860287 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:12.859795    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:12.860287 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.859901    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:12.860287 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:12.860000    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:12.860287 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:12.860132    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:13.859044 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:13.859011    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:13.859206 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:13.859126    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:14.858905 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:14.858871    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:14.859440 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:14.858871    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:14.859440 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:14.858994    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:14.859440 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:14.859093    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:15.858777 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:15.858745    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:15.858947 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:15.858851    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:16.861762 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:16.861735    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:16.862155 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:16.861735    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:16.862155 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:16.861874    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:16.862155 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:16.861909    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:17.858647 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:17.858610    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:17.858854 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:17.858746    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:18.861565 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:18.861533    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:18.861565 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:18.861547    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:18.862022 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:18.861655    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:18.862022 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:18.861802    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:19.858475 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:19.858445    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:19.858670 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:19.858554    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:20.463090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:20.463054    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:20.463499 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.463183    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:20.463499 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.463246    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:36.463226272 +0000 UTC m=+34.157153696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:20.564203 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:20.564176    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:20.564362 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:20.564219    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:20.564362 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564333    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:20.564459 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564364    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:20.564459 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564386    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:20.564459 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564407    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:20.564459 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564386    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:36.564371916 +0000 UTC m=+34.258299335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:20.564620 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.564463    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:05:36.564446676 +0000 UTC m=+34.258374101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:20.858978 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:20.858885    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:20.859135 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:20.858894    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:20.859135 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.859025    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:20.859135 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:20.859066    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:21.859344 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:21.859311    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:21.859766 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:21.859445    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:22.858895 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:22.858861    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:22.859031 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:22.858949    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:22.859031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:22.858998    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:22.859110 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:22.859092    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:23.859060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.858861    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:23.859757 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:23.859167    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:23.930916 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.930826    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal" event={"ID":"ecb5e10e9a5b0d3e70008ee6ce282ea9","Type":"ContainerStarted","Data":"5d9fc12469486cc39079037a7c9c76e37463ff91730a7b3419476e1311a9c90f"}
Jul 16 09:05:23.932420 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.932389    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hvqdv" event={"ID":"7fb741ad-738b-4c37-91ca-9f4e7cea123e","Type":"ContainerStarted","Data":"59da4f03fd230d0f37f78ffd5f979a281124889ea7bf105b2fec3477f65fd2cc"}
Jul 16 09:05:23.934039 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.934014    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"91b75378fe36861ca108320766994d59f38c5cadf1b44fdd96ff112e6abcccd0"}
Jul 16 09:05:23.935505 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.935481    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-94h2h" event={"ID":"6912b4e7-3f36-46ef-a1cf-c917d06c33ff","Type":"ContainerStarted","Data":"d99e7195128fde29755ca8b13f8a2ebc0552b16a36b025fe57ec0b9553dddeb4"}
Jul 16 09:05:23.937048 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.937025    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmgjn" event={"ID":"ccc440bf-6733-4a53-999f-cb09ce38c661","Type":"ContainerStarted","Data":"c85f2bfda2b34476133bf0fcd323b1f64c71eb7c6a8497fc41d38eb950bdd0a2"}
Jul 16 09:05:23.938510 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.938483    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8b8c" event={"ID":"d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985","Type":"ContainerStarted","Data":"2f8379ce41a3ebc9c85292300db86a0b4c41cf29ba234bf7990f60172e9b1d25"}
Jul 16 09:05:23.940042 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.940017    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="adfa050bfbd14730b3cb2be7aa7fb4f2caadb3d74c3313693638b53ef434c6a9" exitCode=0
Jul 16 09:05:23.940126 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.940089    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"adfa050bfbd14730b3cb2be7aa7fb4f2caadb3d74c3313693638b53ef434c6a9"}
Jul 16 09:05:23.941797 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.941772    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gdsjt" event={"ID":"4967901f-de92-48f8-a7fb-b4f5bc3ba144","Type":"ContainerStarted","Data":"7efe2ddb28b94629b7cbde0b6f29bd4dd4748d0b08141ff27ccf75d5e7447bf6"}
Jul 16 09:05:23.943281 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.943258    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69" event={"ID":"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b","Type":"ContainerStarted","Data":"57d94615518c4fcffad15238277834b7d7b8a17d64def6ecea35f9118ceb2d93"}
Jul 16 09:05:23.945728 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.945598    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-79.ec2.internal" podStartSLOduration=19.945587157 podStartE2EDuration="19.945587157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:23.945338311 +0000 UTC m=+21.639265752" watchObservedRunningTime="2026-07-16 09:05:23.945587157 +0000 UTC m=+21.639514598"
Jul 16 09:05:23.977645 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.977600    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w8b8c" podStartSLOduration=10.914450709 podStartE2EDuration="20.977586346s" totalImagesPullingTime="10.063135637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:23.977340684 +0000 UTC m=+21.671268126" watchObservedRunningTime="2026-07-16 09:05:23.977586346 +0000 UTC m=+21.671513784"
Jul 16 09:05:23.991553 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:23.991512    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hvqdv" podStartSLOduration=3.280111109 podStartE2EDuration="20.991499348s" totalImagesPullingTime="17.711388239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:23.991114575 +0000 UTC m=+21.685042018" watchObservedRunningTime="2026-07-16 09:05:23.991499348 +0000 UTC m=+21.685426789"
Jul 16 09:05:24.006918 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.006873    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hmgjn" podStartSLOduration=3.878525797 podStartE2EDuration="22.006858186s" totalImagesPullingTime="18.128332389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:24.006671174 +0000 UTC m=+21.700598614" watchObservedRunningTime="2026-07-16 09:05:24.006858186 +0000 UTC m=+21.700785628"
Jul 16 09:05:24.021754 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.021716    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-94h2h" podStartSLOduration=3.9459087349999997 podStartE2EDuration="22.021688243s" totalImagesPullingTime="18.075779508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:24.021552308 +0000 UTC m=+21.715479743" watchObservedRunningTime="2026-07-16 09:05:24.021688243 +0000 UTC m=+21.715615682"
Jul 16 09:05:24.037192 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.037063    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gdsjt" podStartSLOduration=3.984825581 podStartE2EDuration="22.037050908s" totalImagesPullingTime="18.052225327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:24.036915693 +0000 UTC m=+21.730843133" watchObservedRunningTime="2026-07-16 09:05:24.037050908 +0000 UTC m=+21.730978348"
Jul 16 09:05:24.747015 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.746988    2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 09:05:24.823851 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.823755    2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T09:05:24.74700446Z","UUID":"04e752f5-0fe1-47a5-8fe6-531753f4f256","Handler":null,"Name":"","Endpoint":""}
Jul 16 09:05:24.825457 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.825426    2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 09:05:24.825457 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.825463    2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 09:05:24.858570 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.858498    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:24.858736 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.858498    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:24.858736 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:24.858626    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:24.858736 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:24.858678    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:24.946982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.946949    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x57jh" event={"ID":"3ddffdff-7b8e-46b4-8110-98e705850c3c","Type":"ContainerStarted","Data":"c309b260066e471703a33656c242052890f634877090ee9267e28305b7b54021"}
Jul 16 09:05:24.948999 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.948971    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69" event={"ID":"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b","Type":"ContainerStarted","Data":"834339818e6f4df7f30730d05cc550690370ff15e5ac7449e63c09bf0acab1b8"}
Jul 16 09:05:24.952062 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.952033    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"f3ce5e8c5b57e6870867e471e07e2ae00b9e6c44f8b4d9806e66e9a4b8b6a9fb"}
Jul 16 09:05:24.952172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.952110    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"3ae5cff67f2294df9238f0601d6295ac3467c33c141cf8254a511abefa2b63be"}
Jul 16 09:05:24.952172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.952163    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"1c0536c8394a9310822cc801642f7012a64479d469170d1917bcb637b2cb2209"}
Jul 16 09:05:24.952279 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.952208    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"d42d2b040ba3b12f95df386e3fceff30e1ab7948d972cfca53e22c61a1a647e9"}
Jul 16 09:05:24.952279 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.952255    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"c5d6d9c26080c0dc704ecf0fb0235fdf60d0c451017ca38ea0157eb72a1d4f10"}
Jul 16 09:05:24.962935 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:24.962895    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x57jh" podStartSLOduration=3.913508637 podStartE2EDuration="21.962880271s" totalImagesPullingTime="18.049371634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:24.962416312 +0000 UTC m=+22.656343745" watchObservedRunningTime="2026-07-16 09:05:24.962880271 +0000 UTC m=+22.656807733"
Jul 16 09:05:25.858672 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:25.858640    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:25.858965 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:25.858801    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:26.859042 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:26.858746    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:26.859569 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:26.859157    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:26.859569 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:26.858967    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:26.859677 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:26.859589    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:26.959364 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:26.959326    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69" event={"ID":"53c590a1-f7bb-43dc-8aa7-f1c1e3cb936b","Type":"ContainerStarted","Data":"65b6c04ed062115e94f8c66e122c7872a108d3e0315cd44d636d15b64d87b654"}
Jul 16 09:05:26.977024 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:26.976969    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btx69" podStartSLOduration=4.515264055 podStartE2EDuration="24.976952411s" totalImagesPullingTime="20.461688356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:26.976926291 +0000 UTC m=+24.670853736" watchObservedRunningTime="2026-07-16 09:05:26.976952411 +0000 UTC m=+24.670879843"
Jul 16 09:05:27.859131 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:27.859094    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:27.859637 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:27.859232    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:28.538470 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.538446    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:28.539000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.538983    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:28.859251 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.859170    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:28.859910 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:28.859290    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:28.859910 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.859351    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:28.859910 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:28.859454    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:28.967021 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.966987    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"aaf0e7a2d2d3fcbf6fe27d569470d9540137dca4ea0f755fc10a0479919fe50d"}
Jul 16 09:05:28.968695 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.968668    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="e330591b310145c95352c14c27598d7a0b10c3a905aa8c76bf50db60a730ff3c" exitCode=0
Jul 16 09:05:28.968840 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.968750    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"e330591b310145c95352c14c27598d7a0b10c3a905aa8c76bf50db60a730ff3c"}
Jul 16 09:05:28.969022 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.969000    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:28.969512 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:28.969493    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w8b8c"
Jul 16 09:05:29.859159 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:29.859126    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:29.859332 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:29.859237    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:30.858787 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.858598    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:30.858982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.858599    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:30.858982 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:30.858876    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:30.858982 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:30.858972    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:30.975203 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.975180    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="bcf5bf8d0bb833645dd9d512ec9606806e8260a68898fae3d2e714fd25a5aae4" exitCode=0
Jul 16 09:05:30.975663 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.975258    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"bcf5bf8d0bb833645dd9d512ec9606806e8260a68898fae3d2e714fd25a5aae4"}
Jul 16 09:05:30.978769 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.978751    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" event={"ID":"6cf97955-528c-4fea-a719-811578fc6557","Type":"ContainerStarted","Data":"24f554feb256332b828f403c31a9b6c6e79324c187dd8a21573220c79e2aed04"}
Jul 16 09:05:30.978956 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.978944    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:30.979016 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.978998    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:30.979069 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.979041    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:30.993597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.993579    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:30.993674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:30.993662    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:05:31.021097 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:31.021047    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b" podStartSLOduration=9.447234567 podStartE2EDuration="28.021036271s" totalImagesPullingTime="18.573801704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:31.019872919 +0000 UTC m=+28.713800350" watchObservedRunningTime="2026-07-16 09:05:31.021036271 +0000 UTC m=+28.714963712"
Jul 16 09:05:31.859292 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:31.859261    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:31.859461 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:31.859362    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:32.437308 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.437237    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hhgz"]
Jul 16 09:05:32.438017 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.437385    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:32.438017 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:32.437526    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:32.438017 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.437766    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wwbgr"]
Jul 16 09:05:32.438017 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.437860    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:32.438017 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:32.437945    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:32.449206 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.449180    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrq68"]
Jul 16 09:05:32.449335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.449273    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:32.449390 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:32.449370    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:32.984985 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.984799    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="06106164943ba9b9484a4aea1dee5947310b9424a08682ae61d891905b292566" exitCode=0
Jul 16 09:05:32.985176 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:32.984876    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"06106164943ba9b9484a4aea1dee5947310b9424a08682ae61d891905b292566"}
Jul 16 09:05:33.858896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:33.858856    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:33.858896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:33.858897    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:33.859603 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:33.858965    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:33.859603 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:33.858985    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:33.859603 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:33.859055    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:33.859603 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:33.859129    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:35.858781 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:35.858745    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:35.859280 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:35.858750    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:35.859280 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:35.858874    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:35.859280 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:35.858874    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hrq68" podUID="d27c408d-862b-4972-8c5c-6290c2b725f1"
Jul 16 09:05:35.859280 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:35.858974    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:05:35.859280 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:35.859051    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wwbgr" podUID="2b56c72d-4a48-47d9-b2a6-f29c0931e2ac"
Jul 16 09:05:36.478581 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:36.478550    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:36.478788 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.478738    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:36.478848 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.478803    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:08.478787525 +0000 UTC m=+66.172714947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 09:05:36.579668 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:36.579630    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:36.579860 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:36.579714    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:36.579860 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.579826    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:36.579959 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.579888    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret podName:d27c408d-862b-4972-8c5c-6290c2b725f1 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:08.579870343 +0000 UTC m=+66.273797765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret") pod "global-pull-secret-syncer-hrq68" (UID: "d27c408d-862b-4972-8c5c-6290c2b725f1") : object "kube-system"/"original-pull-secret" not registered
Jul 16 09:05:36.579959 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.579827    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 09:05:36.579959 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.579934    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 09:05:36.579959 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.579950    2550 projected.go:196] Error preparing data for projected volume kube-api-access-tld7n for pod openshift-network-diagnostics/network-check-target-wwbgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:36.580116 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:36.580000    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n podName:2b56c72d-4a48-47d9-b2a6-f29c0931e2ac nodeName:}" failed. No retries permitted until 2026-07-16 09:06:08.579988327 +0000 UTC m=+66.273915747 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tld7n" (UniqueName: "kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n") pod "network-check-target-wwbgr" (UID: "2b56c72d-4a48-47d9-b2a6-f29c0931e2ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 09:05:37.115010 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.114933    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-79.ec2.internal" event="NodeReady"
Jul 16 09:05:37.115484 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.115063    2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 09:05:37.162777 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.162738    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vx95c"]
Jul 16 09:05:37.167780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.167757    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mfvv2"]
Jul 16 09:05:37.167912 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.167879    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.170180 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.170125    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 09:05:37.170563 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.170389    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 09:05:37.170563 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.170450    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmnzs\""
Jul 16 09:05:37.171374 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.171354    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.173961 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.173648    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 09:05:37.173961 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.173687    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 09:05:37.173961 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.173821    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 09:05:37.174198 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.174027    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q4lck\""
Jul 16 09:05:37.175292 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.175277    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vx95c"]
Jul 16 09:05:37.178613 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.178591    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfvv2"]
Jul 16 09:05:37.284336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284304    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.284336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284339    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6244f24-34cc-4ed2-924f-5a4554868559-config-volume\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.284548 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284374    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dtc7\" (UniqueName: \"kubernetes.io/projected/29df0134-df10-48d8-89d4-6885c4a17d1b-kube-api-access-4dtc7\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.284548 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284436    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwvm\" (UniqueName: \"kubernetes.io/projected/a6244f24-34cc-4ed2-924f-5a4554868559-kube-api-access-hxwvm\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.284548 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284465    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6244f24-34cc-4ed2-924f-5a4554868559-tmp-dir\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.284548 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.284488    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df0134-df10-48d8-89d4-6885c4a17d1b-cert\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.385515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385484    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.385515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385517    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6244f24-34cc-4ed2-924f-5a4554868559-config-volume\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.385733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385555    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dtc7\" (UniqueName: \"kubernetes.io/projected/29df0134-df10-48d8-89d4-6885c4a17d1b-kube-api-access-4dtc7\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.385733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385588    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwvm\" (UniqueName: \"kubernetes.io/projected/a6244f24-34cc-4ed2-924f-5a4554868559-kube-api-access-hxwvm\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.385733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385604    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6244f24-34cc-4ed2-924f-5a4554868559-tmp-dir\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.385733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385624    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df0134-df10-48d8-89d4-6885c4a17d1b-cert\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.385920 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:37.385739    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:37.385920 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:37.385819    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:37.885796821 +0000 UTC m=+35.579724259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:37.386056 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.385963    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6244f24-34cc-4ed2-924f-5a4554868559-tmp-dir\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.386121 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.386106    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6244f24-34cc-4ed2-924f-5a4554868559-config-volume\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.389578 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.389562    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df0134-df10-48d8-89d4-6885c4a17d1b-cert\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.394576 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.394555    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwvm\" (UniqueName: \"kubernetes.io/projected/a6244f24-34cc-4ed2-924f-5a4554868559-kube-api-access-hxwvm\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.394927 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.394884    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dtc7\" (UniqueName: \"kubernetes.io/projected/29df0134-df10-48d8-89d4-6885c4a17d1b-kube-api-access-4dtc7\") pod \"ingress-canary-mfvv2\" (UID: \"29df0134-df10-48d8-89d4-6885c4a17d1b\") " pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.487454 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.487414    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfvv2"
Jul 16 09:05:37.634674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.634456    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfvv2"]
Jul 16 09:05:37.637826 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:37.637791    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29df0134_df10_48d8_89d4_6885c4a17d1b.slice/crio-b01817fc03963617619bc52b1197c7aa499d02a815779f5e926875c6e31448ba WatchSource:0}: Error finding container b01817fc03963617619bc52b1197c7aa499d02a815779f5e926875c6e31448ba: Status 404 returned error can't find the container with id b01817fc03963617619bc52b1197c7aa499d02a815779f5e926875c6e31448ba
Jul 16 09:05:37.858395 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.858360    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:05:37.858395 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.858395    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:05:37.858680 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.858360    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:05:37.861263 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861241    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwv7m\""
Jul 16 09:05:37.861871 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861848    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 09:05:37.862000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861872    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h777f\""
Jul 16 09:05:37.862000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861926    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 09:05:37.862000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861872    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 09:05:37.862000 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.861992    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 09:05:37.889696 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.889631    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:37.889823 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:37.889744    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:37.889823 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:37.889792    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:38.889779338 +0000 UTC m=+36.583706758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:37.996597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.996561    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfvv2" event={"ID":"29df0134-df10-48d8-89d4-6885c4a17d1b","Type":"ContainerStarted","Data":"b01817fc03963617619bc52b1197c7aa499d02a815779f5e926875c6e31448ba"}
Jul 16 09:05:37.999062 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.999039    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="2866a5886017c24878bcaeb4884fd96650757db9e0ba84cf659f11a2d9f3a1b4" exitCode=0
Jul 16 09:05:37.999173 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:37.999068    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"2866a5886017c24878bcaeb4884fd96650757db9e0ba84cf659f11a2d9f3a1b4"}
Jul 16 09:05:38.896592 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:38.896553    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:38.897054 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:38.896666    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:38.897054 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:38.896733    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:40.896720269 +0000 UTC m=+38.590647688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:39.006798 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:39.006761    2550 generic.go:356] "Generic (PLEG): container finished" podID="ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b" containerID="b0691de039db633da2586620d78a367d5f056d54186647394a4c295000f464d7" exitCode=0
Jul 16 09:05:39.006970 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:39.006806    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerDied","Data":"b0691de039db633da2586620d78a367d5f056d54186647394a4c295000f464d7"}
Jul 16 09:05:40.014341 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:40.014110    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" event={"ID":"ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b","Type":"ContainerStarted","Data":"a4047c9de6a282eed1b4766940a282227ec35a55765c9b246fbf1886108235b5"}
Jul 16 09:05:40.015713 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:40.015673    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfvv2" event={"ID":"29df0134-df10-48d8-89d4-6885c4a17d1b","Type":"ContainerStarted","Data":"8b7c089058f0a45da0189a9a6cc1c24bdcbd1131b28c3f77be091c0d253a7292"}
Jul 16 09:05:40.039059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:40.039007    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hbkbp" podStartSLOduration=8.481794996 podStartE2EDuration="38.038990585s" totalImagesPullingTime="29.557195589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:40.037472975 +0000 UTC m=+37.731400450" watchObservedRunningTime="2026-07-16 09:05:40.038990585 +0000 UTC m=+37.732918027"
Jul 16 09:05:40.053093 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:40.053043    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mfvv2" podStartSLOduration=0.79035746 podStartE2EDuration="3.053026754s" totalImagesPullingTime="2.262669294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:40.052478002 +0000 UTC m=+37.746405461" watchObservedRunningTime="2026-07-16 09:05:40.053026754 +0000 UTC m=+37.746954195"
Jul 16 09:05:40.912884 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:40.912847    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:40.913067 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:40.913002    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:40.913109 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:40.913072    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:44.913056475 +0000 UTC m=+42.606983895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:44.939298 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:44.939265    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:44.939783 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:44.939379    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:44.939783 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:44.939429    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:05:52.939415427 +0000 UTC m=+50.633342846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:47.744603 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.744572    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"]
Jul 16 09:05:47.780374 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.780342    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"]
Jul 16 09:05:47.780374 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.780374    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"]
Jul 16 09:05:47.780563 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.780473    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:47.783029 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.783005    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 09:05:47.783163 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.783148    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 09:05:47.783354 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.783333    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 09:05:47.783354 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.783341    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mv4x6\""
Jul 16 09:05:47.783354 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.783344    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 09:05:47.794124 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.794103    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"]
Jul 16 09:05:47.794228 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.794193    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.798312 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.798293    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 09:05:47.798515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.798499    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 09:05:47.798807 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.798792    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 09:05:47.798922 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.798906    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 09:05:47.960007 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.959973    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.960191 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960058    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.960191 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960103    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/713667ac-f671-46d8-90e0-e348af1bee41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.960191 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960127    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043313e0-f377-42c5-a87f-e368b22d0df8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:47.960350 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.960350 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960255    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk94j\" (UniqueName: \"kubernetes.io/projected/713667ac-f671-46d8-90e0-e348af1bee41-kube-api-access-mk94j\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:47.960350 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960281    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bthp6\" (UniqueName: \"kubernetes.io/projected/043313e0-f377-42c5-a87f-e368b22d0df8-kube-api-access-bthp6\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:47.960460 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:47.960349    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061477 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061370    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061477 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061427    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061556    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/713667ac-f671-46d8-90e0-e348af1bee41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061597    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043313e0-f377-42c5-a87f-e368b22d0df8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:48.061733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061667    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061724    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk94j\" (UniqueName: \"kubernetes.io/projected/713667ac-f671-46d8-90e0-e348af1bee41-kube-api-access-mk94j\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.061906 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061750    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bthp6\" (UniqueName: \"kubernetes.io/projected/043313e0-f377-42c5-a87f-e368b22d0df8-kube-api-access-bthp6\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:48.061906 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.061813    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.062326 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.062295    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/713667ac-f671-46d8-90e0-e348af1bee41-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.065765 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.065732    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-ca\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.065896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.065808    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.065896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.065852    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.065977 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.065896    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/713667ac-f671-46d8-90e0-e348af1bee41-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.065977 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.065897    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/043313e0-f377-42c5-a87f-e368b22d0df8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:48.070394 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.070363    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk94j\" (UniqueName: \"kubernetes.io/projected/713667ac-f671-46d8-90e0-e348af1bee41-kube-api-access-mk94j\") pod \"cluster-proxy-proxy-agent-7d74c8d8f-mr9w6\" (UID: \"713667ac-f671-46d8-90e0-e348af1bee41\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.070717 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.070679    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bthp6\" (UniqueName: \"kubernetes.io/projected/043313e0-f377-42c5-a87f-e368b22d0df8-kube-api-access-bthp6\") pod \"managed-serviceaccount-addon-agent-858f57f7bd-8fz6w\" (UID: \"043313e0-f377-42c5-a87f-e368b22d0df8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:48.100348 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.100308    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:05:48.106483 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.106456    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:05:48.259227 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.259193    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"]
Jul 16 09:05:48.262480 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:48.262452    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod043313e0_f377_42c5_a87f_e368b22d0df8.slice/crio-7ca0583be62bcd37bb1af08af37593177db8b2dec16adc76ee0f1d12fb9a085b WatchSource:0}: Error finding container 7ca0583be62bcd37bb1af08af37593177db8b2dec16adc76ee0f1d12fb9a085b: Status 404 returned error can't find the container with id 7ca0583be62bcd37bb1af08af37593177db8b2dec16adc76ee0f1d12fb9a085b
Jul 16 09:05:48.275835 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:48.275810    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"]
Jul 16 09:05:48.278843 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:05:48.278821    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod713667ac_f671_46d8_90e0_e348af1bee41.slice/crio-f7de4d43cc4eeee30617fa1995e31229fbc1a4a9907ef98ea7bf8c1165c07027 WatchSource:0}: Error finding container f7de4d43cc4eeee30617fa1995e31229fbc1a4a9907ef98ea7bf8c1165c07027: Status 404 returned error can't find the container with id f7de4d43cc4eeee30617fa1995e31229fbc1a4a9907ef98ea7bf8c1165c07027
Jul 16 09:05:49.039497 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:49.039451    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerStarted","Data":"7ca0583be62bcd37bb1af08af37593177db8b2dec16adc76ee0f1d12fb9a085b"}
Jul 16 09:05:49.040457 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:49.040436    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerStarted","Data":"f7de4d43cc4eeee30617fa1995e31229fbc1a4a9907ef98ea7bf8c1165c07027"}
Jul 16 09:05:52.996789 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:52.996752    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:05:52.997181 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:52.996868    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:05:52.997181 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:05:52.996921    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:08.996907023 +0000 UTC m=+66.690834446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:05:53.051824 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:53.051792    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerStarted","Data":"0853544111b88788661562081d3eb42a9fb9bc35210ad71c241d0a6d1e0ff1ea"}
Jul 16 09:05:53.067115 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:05:53.067065    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" podStartSLOduration=1.4986081580000001 podStartE2EDuration="6.067050405s" totalImagesPullingTime="4.568442247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:53.066674405 +0000 UTC m=+50.760601846" watchObservedRunningTime="2026-07-16 09:05:53.067050405 +0000 UTC m=+50.760977845"
Jul 16 09:06:02.997981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:02.997950    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4jx6b"
Jul 16 09:06:05.081996 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:05.081958    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerStarted","Data":"1e360cecd9f57e4cf9cb18142977d15a9605c26349384f8bd38424c9e00ae712"}
Jul 16 09:06:05.082466 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:05.082006    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerStarted","Data":"55b25983fad1edb131242e7da4d40fc4081420a9515a1efffd53d9adffdcc525"}
Jul 16 09:06:05.082466 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:05.082025    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerStarted","Data":"e4046e047889ca7cc2cadc2e2b935f948411db6efb11e5e24683262dec69400b"}
Jul 16 09:06:05.100969 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:05.100921    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" podStartSLOduration=2.05932156 podStartE2EDuration="18.100904219s" totalImagesPullingTime="16.041582659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:05.098986196 +0000 UTC m=+62.792913637" watchObservedRunningTime="2026-07-16 09:06:05.100904219 +0000 UTC m=+62.794831660"
Jul 16 09:06:08.513973 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.513927    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:06:08.516521 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.516503    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 09:06:08.524185 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:08.524164    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:06:08.524279 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:08.524226    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:07:12.524206412 +0000 UTC m=+130.218133833 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : secret "metrics-daemon-secret" not found
Jul 16 09:06:08.614553 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.614517    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:06:08.614753 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.614581    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:06:08.617210 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.617190    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 09:06:08.617298 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.617280    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 09:06:08.626917 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.626893    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 09:06:08.627203 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.627188    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d27c408d-862b-4972-8c5c-6290c2b725f1-original-pull-secret\") pod \"global-pull-secret-syncer-hrq68\" (UID: \"d27c408d-862b-4972-8c5c-6290c2b725f1\") " pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:06:08.637748 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.637727    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tld7n\" (UniqueName: \"kubernetes.io/projected/2b56c72d-4a48-47d9-b2a6-f29c0931e2ac-kube-api-access-tld7n\") pod \"network-check-target-wwbgr\" (UID: \"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac\") " pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:06:08.774509 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.774422    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hrq68"
Jul 16 09:06:08.781095 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.781074    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xwv7m\""
Jul 16 09:06:08.788874 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.788857    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:06:08.927079 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.927049    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hrq68"]
Jul 16 09:06:08.930190 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:06:08.930153    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27c408d_862b_4972_8c5c_6290c2b725f1.slice/crio-da1412a5f6dfb0c8c79e7adda725239bdf118c1cd3d09ad5dda84f71da1fce1e WatchSource:0}: Error finding container da1412a5f6dfb0c8c79e7adda725239bdf118c1cd3d09ad5dda84f71da1fce1e: Status 404 returned error can't find the container with id da1412a5f6dfb0c8c79e7adda725239bdf118c1cd3d09ad5dda84f71da1fce1e
Jul 16 09:06:08.948779 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:08.948737    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wwbgr"]
Jul 16 09:06:08.952539 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:06:08.952505    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b56c72d_4a48_47d9_b2a6_f29c0931e2ac.slice/crio-c0b8dd984db2dcdaaf46ea49d158c165526bed3aa05967747c9ad1b09fc544fc WatchSource:0}: Error finding container c0b8dd984db2dcdaaf46ea49d158c165526bed3aa05967747c9ad1b09fc544fc: Status 404 returned error can't find the container with id c0b8dd984db2dcdaaf46ea49d158c165526bed3aa05967747c9ad1b09fc544fc
Jul 16 09:06:09.019540 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:09.019507    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:06:09.019725 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:09.019665    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:06:09.019769 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:09.019750    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:06:41.019732623 +0000 UTC m=+98.713660043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:06:09.092639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:09.092563    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrq68" event={"ID":"d27c408d-862b-4972-8c5c-6290c2b725f1","Type":"ContainerStarted","Data":"da1412a5f6dfb0c8c79e7adda725239bdf118c1cd3d09ad5dda84f71da1fce1e"}
Jul 16 09:06:09.093523 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:09.093505    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wwbgr" event={"ID":"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac","Type":"ContainerStarted","Data":"c0b8dd984db2dcdaaf46ea49d158c165526bed3aa05967747c9ad1b09fc544fc"}
Jul 16 09:06:12.104313 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:12.104271    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wwbgr" event={"ID":"2b56c72d-4a48-47d9-b2a6-f29c0931e2ac","Type":"ContainerStarted","Data":"b9682be905c2ba3b614fa8b494c1d97f2ac6b0d4093aaf46d39fce92ac255fb9"}
Jul 16 09:06:12.104795 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:12.104437    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:06:12.122108 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:12.122058    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wwbgr" podStartSLOduration=67.195624068 podStartE2EDuration="1m10.122043188s" totalImagesPullingTime="2.92641912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:12.121918386 +0000 UTC m=+69.815846041" watchObservedRunningTime="2026-07-16 09:06:12.122043188 +0000 UTC m=+69.815970628"
Jul 16 09:06:14.115673 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:14.115628    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hrq68" event={"ID":"d27c408d-862b-4972-8c5c-6290c2b725f1","Type":"ContainerStarted","Data":"905f6b9ff62576479d1bbb61792dc22059bedf814f8f3a3799d7f866fd326b4d"}
Jul 16 09:06:14.131663 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:14.131617    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hrq68" podStartSLOduration=66.655757575 podStartE2EDuration="1m11.131602379s" totalImagesPullingTime="4.475844804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:14.131441531 +0000 UTC m=+71.825368971" watchObservedRunningTime="2026-07-16 09:06:14.131602379 +0000 UTC m=+71.825529820"
Jul 16 09:06:41.037299 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:41.037166    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:06:41.037769 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:41.037309    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:06:41.037769 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:06:41.037391    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:07:45.0373735 +0000 UTC m=+162.731300920 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:06:43.114004 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:06:43.113977    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wwbgr"
Jul 16 09:07:12.553631 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:12.553582    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:07:12.554174 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:12.553753    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:07:12.554174 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:12.553855    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:14.553835347 +0000 UTC m=+252.247762772 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : secret "metrics-daemon-secret" not found
Jul 16 09:07:40.182238 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:40.182188    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vx95c" podUID="a6244f24-34cc-4ed2-924f-5a4554868559"
Jul 16 09:07:40.364076 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:40.364049    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:07:40.868406 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:40.868369    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:07:45.066835 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:45.066796    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:07:45.067229 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:45.066931    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 09:07:45.067229 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:07:45.067006    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls podName:a6244f24-34cc-4ed2-924f-5a4554868559 nodeName:}" failed. No retries permitted until 2026-07-16 09:09:47.066988777 +0000 UTC m=+284.760916196 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls") pod "dns-default-vx95c" (UID: "a6244f24-34cc-4ed2-924f-5a4554868559") : secret "dns-default-metrics-tls" not found
Jul 16 09:07:53.399505 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:53.399474    2550 generic.go:356] "Generic (PLEG): container finished" podID="043313e0-f377-42c5-a87f-e368b22d0df8" containerID="0853544111b88788661562081d3eb42a9fb9bc35210ad71c241d0a6d1e0ff1ea" exitCode=255
Jul 16 09:07:53.399882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:53.399546    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerDied","Data":"0853544111b88788661562081d3eb42a9fb9bc35210ad71c241d0a6d1e0ff1ea"}
Jul 16 09:07:53.399882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:53.399845    2550 scope.go:117] "RemoveContainer" containerID="0853544111b88788661562081d3eb42a9fb9bc35210ad71c241d0a6d1e0ff1ea"
Jul 16 09:07:53.858952 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:53.858854    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:07:54.403229 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:07:54.403194    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerStarted","Data":"acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78"}
Jul 16 09:09:14.569680 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:14.569628    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:09:14.570195 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:14.569808    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 09:09:14.570195 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:14.569885    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs podName:ec102fe0-31ab-4f36-bd89-479b15643e15 nodeName:}" failed. No retries permitted until 2026-07-16 09:11:16.569868753 +0000 UTC m=+374.263796176 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs") pod "network-metrics-daemon-9hhgz" (UID: "ec102fe0-31ab-4f36-bd89-479b15643e15") : secret "metrics-daemon-secret" not found
Jul 16 09:09:26.156972 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.156892    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rvjqq"]
Jul 16 09:09:26.158941 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.158914    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.161878 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.161858    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 09:09:26.162148 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.162130    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 09:09:26.162231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.162185    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 09:09:26.162231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.162213    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 09:09:26.162340 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.162249    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gw7j9\""
Jul 16 09:09:26.173298 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.173269    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvjqq"]
Jul 16 09:09:26.253196 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.253159    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557dafc6-d789-433b-9d6f-3fd710e52e5c-crio-socket\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.253399 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.253212    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557dafc6-d789-433b-9d6f-3fd710e52e5c-data-volume\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.253399 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.253327    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.253399 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.253373    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt2xp\" (UniqueName: \"kubernetes.io/projected/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-api-access-lt2xp\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.253527 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.253402    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353672    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353731    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt2xp\" (UniqueName: \"kubernetes.io/projected/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-api-access-lt2xp\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353760    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353790    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557dafc6-d789-433b-9d6f-3fd710e52e5c-crio-socket\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353834    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557dafc6-d789-433b-9d6f-3fd710e52e5c-data-volume\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.353836    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.353909 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.353894    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.354183 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.353910    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/557dafc6-d789-433b-9d6f-3fd710e52e5c-crio-socket\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.354183 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.353923    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:26.853901213 +0000 UTC m=+264.547828649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.354183 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.353965    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:26.853949845 +0000 UTC m=+264.547877271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.354313 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.354221    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/557dafc6-d789-433b-9d6f-3fd710e52e5c-data-volume\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.369905 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.369873    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt2xp\" (UniqueName: \"kubernetes.io/projected/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-api-access-lt2xp\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.857933 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.857895    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.858184 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:26.857981    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:26.858184 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.858032    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.858184 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.858068    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:26.858184 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.858113    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:27.858096233 +0000 UTC m=+265.552023652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:26.858184 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:26.858128    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:27.858121943 +0000 UTC m=+265.552049362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:27.866500 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:27.866463    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:27.866964 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:27.866565    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:27.866964 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:27.866587    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:27.866964 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:27.866645    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:29.866625581 +0000 UTC m=+267.560553018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:27.866964 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:27.866678    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:27.866964 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:27.866753    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:29.866737233 +0000 UTC m=+267.560664654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:28.121064 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:28.120994    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvqdv_7fb741ad-738b-4c37-91ca-9f4e7cea123e/dns-node-resolver/0.log"
Jul 16 09:09:28.921661 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:28.921634    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gdsjt_4967901f-de92-48f8-a7fb-b4f5bc3ba144/node-ca/0.log"
Jul 16 09:09:29.880322 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:29.880285    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:29.880473 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:29.880363    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:29.880473 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:29.880395    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:29.880473 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:29.880451    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:33.880436721 +0000 UTC m=+271.574364143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:29.880473 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:29.880450    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:29.880614 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:29.880499    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:33.880479956 +0000 UTC m=+271.574407375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:29.925620 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:29.925595    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfvv2_29df0134-df10-48d8-89d4-6885c4a17d1b/serve-healthcheck-canary/0.log"
Jul 16 09:09:33.906827 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:33.906786    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:33.906827 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:33.906833    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:33.907294 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:33.906927    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 09:09:33.907294 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:33.906947    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:33.907294 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:33.906974    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:41.906961523 +0000 UTC m=+279.600888942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : configmap "kube-rbac-proxy" not found
Jul 16 09:09:33.907294 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:33.906998    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls podName:557dafc6-d789-433b-9d6f-3fd710e52e5c nodeName:}" failed. No retries permitted until 2026-07-16 09:09:41.906984912 +0000 UTC m=+279.600912331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rvjqq" (UID: "557dafc6-d789-433b-9d6f-3fd710e52e5c") : secret "insights-runtime-extractor-tls" not found
Jul 16 09:09:41.967001 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:41.966958    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:41.967462 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:41.967012    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:41.967553 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:41.967535    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/557dafc6-d789-433b-9d6f-3fd710e52e5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:41.969399 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:41.969364    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/557dafc6-d789-433b-9d6f-3fd710e52e5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rvjqq\" (UID: \"557dafc6-d789-433b-9d6f-3fd710e52e5c\") " pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:42.070915 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:42.070846    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rvjqq"
Jul 16 09:09:42.189367 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:42.189336    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rvjqq"]
Jul 16 09:09:42.192295 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:09:42.192264    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557dafc6_d789_433b_9d6f_3fd710e52e5c.slice/crio-f9ffa3efe81d667275b2bc712327f3c0a2796edab86665fd6e434f932d5c6f0a WatchSource:0}: Error finding container f9ffa3efe81d667275b2bc712327f3c0a2796edab86665fd6e434f932d5c6f0a: Status 404 returned error can't find the container with id f9ffa3efe81d667275b2bc712327f3c0a2796edab86665fd6e434f932d5c6f0a
Jul 16 09:09:42.693376 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:42.693342    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvjqq" event={"ID":"557dafc6-d789-433b-9d6f-3fd710e52e5c","Type":"ContainerStarted","Data":"f9ffa3efe81d667275b2bc712327f3c0a2796edab86665fd6e434f932d5c6f0a"}
Jul 16 09:09:43.365534 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:43.365492    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vx95c" podUID="a6244f24-34cc-4ed2-924f-5a4554868559"
Jul 16 09:09:43.696465 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:43.696387    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:09:47.101769 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.101738    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:09:47.103907 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.103881    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6244f24-34cc-4ed2-924f-5a4554868559-metrics-tls\") pod \"dns-default-vx95c\" (UID: \"a6244f24-34cc-4ed2-924f-5a4554868559\") " pod="openshift-dns/dns-default-vx95c"
Jul 16 09:09:47.300109 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.300026    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xmnzs\""
Jul 16 09:09:47.308091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.308069    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:09:47.432215 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.432182    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vx95c"]
Jul 16 09:09:47.435200 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:09:47.435174    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6244f24_34cc_4ed2_924f_5a4554868559.slice/crio-2234a818e104431f9ef3784facbded01c786dee8c565a8cf74ecee734a887a94 WatchSource:0}: Error finding container 2234a818e104431f9ef3784facbded01c786dee8c565a8cf74ecee734a887a94: Status 404 returned error can't find the container with id 2234a818e104431f9ef3784facbded01c786dee8c565a8cf74ecee734a887a94
Jul 16 09:09:47.710645 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.710612    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvjqq" event={"ID":"557dafc6-d789-433b-9d6f-3fd710e52e5c","Type":"ContainerStarted","Data":"98bfb80bb44cdba8acf88eeb0a64aaebf87046bf3438a2d02a9b266dbf3aafad"}
Jul 16 09:09:47.711597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:47.711570    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vx95c" event={"ID":"a6244f24-34cc-4ed2-924f-5a4554868559","Type":"ContainerStarted","Data":"2234a818e104431f9ef3784facbded01c786dee8c565a8cf74ecee734a887a94"}
Jul 16 09:09:51.727424 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.727389    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvjqq" event={"ID":"557dafc6-d789-433b-9d6f-3fd710e52e5c","Type":"ContainerStarted","Data":"632892db6bec0069dbc3b89646ad58061a294a461b70c827d33f6b26f9204dba"}
Jul 16 09:09:51.728935 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.728902    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vx95c" event={"ID":"a6244f24-34cc-4ed2-924f-5a4554868559","Type":"ContainerStarted","Data":"fbf3dde2891cf1f67ebf0afb69c016c6d080095d30e8d4ce860da070e8a836d7"}
Jul 16 09:09:51.729060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.728946    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vx95c" event={"ID":"a6244f24-34cc-4ed2-924f-5a4554868559","Type":"ContainerStarted","Data":"46b4efea8bd6aea62977d4fc78a0487cf350478c2c17b7bc56134dea056a02c6"}
Jul 16 09:09:51.729060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.729036    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:09:51.753853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.753800    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vx95c" podStartSLOduration=250.97599902 podStartE2EDuration="4m14.753781765s" totalImagesPullingTime="3.777782745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:51.752854337 +0000 UTC m=+289.446781777" watchObservedRunningTime="2026-07-16 09:09:51.753781765 +0000 UTC m=+289.447709204"
Jul 16 09:09:51.961854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.961817    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-pb27c"]
Jul 16 09:09:51.964829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.964805    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:09:51.965525 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.965495    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c87b5bc9-kl5kc"]
Jul 16 09:09:51.967160 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.967135    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 16 09:09:51.967277 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.967190    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zdqfs\""
Jul 16 09:09:51.967277 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.967190    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 16 09:09:51.968407 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.968391    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:51.970378 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.970358    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 09:09:51.970971 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.970953    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 09:09:51.971059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.970972    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 09:09:51.971059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.971024    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dsdg\""
Jul 16 09:09:51.976135 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.976113    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pb27c"]
Jul 16 09:09:51.977413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.977394    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 09:09:51.987142 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:51.987120    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c87b5bc9-kl5kc"]
Jul 16 09:09:52.041894 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.041844    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-certificates\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.041906    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-installation-pull-secrets\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.041938    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-bound-sa-token\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.041967    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-trusted-ca\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042177 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.042070    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mntc\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-kube-api-access-2mntc\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042177 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.042101    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-ca-trust-extracted\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042177 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.042125    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvbcx\" (UniqueName: \"kubernetes.io/projected/7085f5f1-1126-408d-80eb-e6efe36fd2b9-kube-api-access-zvbcx\") pod \"downloads-68c9cbb497-pb27c\" (UID: \"7085f5f1-1126-408d-80eb-e6efe36fd2b9\") " pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:09:52.042177 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.042169    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-tls\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.042337 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.042214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-image-registry-private-configuration\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143193 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143161    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-certificates\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143193 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143197    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-installation-pull-secrets\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143225    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-bound-sa-token\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143252    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-trusted-ca\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143280    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mntc\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-kube-api-access-2mntc\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143307    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-ca-trust-extracted\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143331    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvbcx\" (UniqueName: \"kubernetes.io/projected/7085f5f1-1126-408d-80eb-e6efe36fd2b9-kube-api-access-zvbcx\") pod \"downloads-68c9cbb497-pb27c\" (UID: \"7085f5f1-1126-408d-80eb-e6efe36fd2b9\") " pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:09:52.143662 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143539    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-tls\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143736 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143656    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-image-registry-private-configuration\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.143965 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.143918    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-ca-trust-extracted\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.144168 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.144150    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-certificates\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.144445 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.144424    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-trusted-ca\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.146583 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.146559    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-image-registry-private-configuration\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.146694 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.146645    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-registry-tls\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.146694 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.146659    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-installation-pull-secrets\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.151920 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.151896    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-bound-sa-token\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.152255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.152234    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mntc\" (UniqueName: \"kubernetes.io/projected/36d4a3ac-9c1c-4776-9bcd-53bf840914f7-kube-api-access-2mntc\") pod \"image-registry-6c87b5bc9-kl5kc\" (UID: \"36d4a3ac-9c1c-4776-9bcd-53bf840914f7\") " pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.153947 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.153356    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvbcx\" (UniqueName: \"kubernetes.io/projected/7085f5f1-1126-408d-80eb-e6efe36fd2b9-kube-api-access-zvbcx\") pod \"downloads-68c9cbb497-pb27c\" (UID: \"7085f5f1-1126-408d-80eb-e6efe36fd2b9\") " pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:09:52.277526 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.277436    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:09:52.283994 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.283970    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.426798 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.426763    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c87b5bc9-kl5kc"]
Jul 16 09:09:52.430111 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:09:52.430085    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d4a3ac_9c1c_4776_9bcd_53bf840914f7.slice/crio-783f44eb49b1047e306041afa29ee7d0c794c8285ab3587e8ae3648f48f24a44 WatchSource:0}: Error finding container 783f44eb49b1047e306041afa29ee7d0c794c8285ab3587e8ae3648f48f24a44: Status 404 returned error can't find the container with id 783f44eb49b1047e306041afa29ee7d0c794c8285ab3587e8ae3648f48f24a44
Jul 16 09:09:52.440671 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.440647    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-pb27c"]
Jul 16 09:09:52.443952 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:09:52.443923    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7085f5f1_1126_408d_80eb_e6efe36fd2b9.slice/crio-bf7babe61202baff1b1842a50b57bc13e71509df87fbf8684864e0d8b7971729 WatchSource:0}: Error finding container bf7babe61202baff1b1842a50b57bc13e71509df87fbf8684864e0d8b7971729: Status 404 returned error can't find the container with id bf7babe61202baff1b1842a50b57bc13e71509df87fbf8684864e0d8b7971729
Jul 16 09:09:52.733652 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.733616    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pb27c" event={"ID":"7085f5f1-1126-408d-80eb-e6efe36fd2b9","Type":"ContainerStarted","Data":"bf7babe61202baff1b1842a50b57bc13e71509df87fbf8684864e0d8b7971729"}
Jul 16 09:09:52.735290 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.735260    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc" event={"ID":"36d4a3ac-9c1c-4776-9bcd-53bf840914f7","Type":"ContainerStarted","Data":"2843c52cbb2f51d5adfda96800ec719255b0b577c589582bbaf328a13ba20236"}
Jul 16 09:09:52.735428 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.735309    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc" event={"ID":"36d4a3ac-9c1c-4776-9bcd-53bf840914f7","Type":"ContainerStarted","Data":"783f44eb49b1047e306041afa29ee7d0c794c8285ab3587e8ae3648f48f24a44"}
Jul 16 09:09:52.735630 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.735611    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:09:52.755991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:52.755947    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc" podStartSLOduration=1.755933274 podStartE2EDuration="1.755933274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:52.754842238 +0000 UTC m=+290.448769692" watchObservedRunningTime="2026-07-16 09:09:52.755933274 +0000 UTC m=+290.449860739"
Jul 16 09:09:55.748910 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.748873    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rvjqq" event={"ID":"557dafc6-d789-433b-9d6f-3fd710e52e5c","Type":"ContainerStarted","Data":"2d74796499bc9aa332ba8dcf3ffd598c6d4ee228eba1679c228d54aee4627a0d"}
Jul 16 09:09:55.750728 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.750687    2550 generic.go:356] "Generic (PLEG): container finished" podID="043313e0-f377-42c5-a87f-e368b22d0df8" containerID="acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78" exitCode=255
Jul 16 09:09:55.750854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.750751    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerDied","Data":"acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78"}
Jul 16 09:09:55.750854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.750789    2550 scope.go:117] "RemoveContainer" containerID="0853544111b88788661562081d3eb42a9fb9bc35210ad71c241d0a6d1e0ff1ea"
Jul 16 09:09:55.751104 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.751085    2550 scope.go:117] "RemoveContainer" containerID="acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78"
Jul 16 09:09:55.751286 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:55.751262    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-858f57f7bd-8fz6w_open-cluster-management-agent-addon(043313e0-f377-42c5-a87f-e368b22d0df8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" podUID="043313e0-f377-42c5-a87f-e368b22d0df8"
Jul 16 09:09:55.766718 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:55.766645    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rvjqq" podStartSLOduration=16.913408352 podStartE2EDuration="29.766622729s" totalImagesPullingTime="12.853214377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:09:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:09:55.766217197 +0000 UTC m=+293.460144629" watchObservedRunningTime="2026-07-16 09:09:55.766622729 +0000 UTC m=+293.460550170"
Jul 16 09:09:56.860075 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:56.860031    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9hhgz" podUID="ec102fe0-31ab-4f36-bd89-479b15643e15"
Jul 16 09:09:58.101567 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:58.101519    2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w"
Jul 16 09:09:58.105643 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:09:58.102195    2550 scope.go:117] "RemoveContainer" containerID="acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78"
Jul 16 09:09:58.105643 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:09:58.102506    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-858f57f7bd-8fz6w_open-cluster-management-agent-addon(043313e0-f377-42c5-a87f-e368b22d0df8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" podUID="043313e0-f377-42c5-a87f-e368b22d0df8"
Jul 16 09:10:01.737618 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:01.737585    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vx95c"
Jul 16 09:10:06.025159 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.025125    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vszvf"]
Jul 16 09:10:06.028599 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.028576    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.033545 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.033481    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 09:10:06.033545 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.033512    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 09:10:06.034009 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.033855    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 09:10:06.034413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.034303    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tg9vk\""
Jul 16 09:10:06.034413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.034305    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 09:10:06.034413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.034348    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 09:10:06.034635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.034617    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 09:10:06.157261 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157225    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-textfile\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157261 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157264    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-metrics-client-ca\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157297    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-tls\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157399    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157430    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-root\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157450    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsx22\" (UniqueName: \"kubernetes.io/projected/49055876-30dd-4959-af97-5ef40864c1a2-kube-api-access-lsx22\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157502    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-sys\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157795 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157543    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.157795 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.157570    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-wtmp\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258220    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258262    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-root\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258285    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsx22\" (UniqueName: \"kubernetes.io/projected/49055876-30dd-4959-af97-5ef40864c1a2-kube-api-access-lsx22\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258304    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-sys\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258351    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258372    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-root\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258379    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-wtmp\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258448    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-textfile\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258474    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-metrics-client-ca\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258500    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-wtmp\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258507    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-tls\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258408    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49055876-30dd-4959-af97-5ef40864c1a2-sys\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.258995 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.258954    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-textfile\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.259170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.259128    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.259303 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.259284    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49055876-30dd-4959-af97-5ef40864c1a2-metrics-client-ca\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.260976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.260958    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-tls\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.261156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.261134    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49055876-30dd-4959-af97-5ef40864c1a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.271221 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.271199    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsx22\" (UniqueName: \"kubernetes.io/projected/49055876-30dd-4959-af97-5ef40864c1a2-kube-api-access-lsx22\") pod \"node-exporter-vszvf\" (UID: \"49055876-30dd-4959-af97-5ef40864c1a2\") " pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:06.339419 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:06.339331    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vszvf"
Jul 16 09:10:08.107718 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.107653    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" podUID="713667ac-f671-46d8-90e0-e348af1bee41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 09:10:08.286488 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:10:08.286460    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49055876_30dd_4959_af97_5ef40864c1a2.slice/crio-34153a6f1a81fab03e86ca93bc4df3c2b85676627a1511d683e72dc469a5b711 WatchSource:0}: Error finding container 34153a6f1a81fab03e86ca93bc4df3c2b85676627a1511d683e72dc469a5b711: Status 404 returned error can't find the container with id 34153a6f1a81fab03e86ca93bc4df3c2b85676627a1511d683e72dc469a5b711
Jul 16 09:10:08.289716 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.289675    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:10:08.309969 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.309940    2550 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 09:10:08.797602 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.797513    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-pb27c" event={"ID":"7085f5f1-1126-408d-80eb-e6efe36fd2b9","Type":"ContainerStarted","Data":"0516da04e4dd9eca41ffa92e161c9888946254a062a0108e5163630a2d6cf70c"}
Jul 16 09:10:08.797789 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.797774    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:10:08.798758 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.798733    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vszvf" event={"ID":"49055876-30dd-4959-af97-5ef40864c1a2","Type":"ContainerStarted","Data":"34153a6f1a81fab03e86ca93bc4df3c2b85676627a1511d683e72dc469a5b711"}
Jul 16 09:10:08.799325 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.799297    2550 patch_prober.go:28] interesting pod/downloads-68c9cbb497-pb27c container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused" start-of-body=
Jul 16 09:10:08.799413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.799339    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-pb27c" podUID="7085f5f1-1126-408d-80eb-e6efe36fd2b9" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.11:8080/\": dial tcp 10.133.0.11:8080: connect: connection refused"
Jul 16 09:10:08.816348 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.816295    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-pb27c" podStartSLOduration=1.787876883 podStartE2EDuration="17.816280417s" totalImagesPullingTime="16.028403534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:09:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:08.815354951 +0000 UTC m=+306.509282394" watchObservedRunningTime="2026-07-16 09:10:08.816280417 +0000 UTC m=+306.510207857"
Jul 16 09:10:08.859074 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:08.859045    2550 scope.go:117] "RemoveContainer" containerID="acd2d37657eff3e857df0eec8e2ac8a03ec893170e09b0b20848bfd2c8796f78"
Jul 16 09:10:09.805335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:09.805295    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-858f57f7bd-8fz6w" event={"ID":"043313e0-f377-42c5-a87f-e368b22d0df8","Type":"ContainerStarted","Data":"23dfeee9055d9af5be4ee6332fe5206d155f181c9922a8026df96ff86af05310"}
Jul 16 09:10:09.821317 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:09.821287    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-pb27c"
Jul 16 09:10:10.810635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:10.810599    2550 generic.go:356] "Generic (PLEG): container finished" podID="49055876-30dd-4959-af97-5ef40864c1a2" containerID="ca912b6e157e6efdad54c6d781b81c4da597e0905849bee130b0499edbce2d52" exitCode=0
Jul 16 09:10:10.811110 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:10.810694    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vszvf" event={"ID":"49055876-30dd-4959-af97-5ef40864c1a2","Type":"ContainerDied","Data":"ca912b6e157e6efdad54c6d781b81c4da597e0905849bee130b0499edbce2d52"}
Jul 16 09:10:10.858660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:10.858629    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:10:11.817027 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:11.816989    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vszvf" event={"ID":"49055876-30dd-4959-af97-5ef40864c1a2","Type":"ContainerStarted","Data":"f4cece2e1336225dd34aff812e7f60ecab558f47e0f6f9ac04e75e60cba6f57f"}
Jul 16 09:10:11.817518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:11.817050    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vszvf" event={"ID":"49055876-30dd-4959-af97-5ef40864c1a2","Type":"ContainerStarted","Data":"4b1e8c8db04e154bae34d4fed787f09743dfe8f07b579ea7596b739f53b8b22e"}
Jul 16 09:10:11.837534 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:11.837475    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vszvf" podStartSLOduration=5.125784947 podStartE2EDuration="6.837457914s" totalImagesPullingTime="1.626006933s" totalInitContainerRuntime="85.666034ms" isStatefulPod=true podCreationTimestamp="2026-07-16 09:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:11.836183704 +0000 UTC m=+309.530111144" watchObservedRunningTime="2026-07-16 09:10:11.837457914 +0000 UTC m=+309.531385359"
Jul 16 09:10:13.743187 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:13.743155    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c87b5bc9-kl5kc"
Jul 16 09:10:15.036937 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.036902    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:10:15.136547 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.136508    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:10:15.136753 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.136607    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.139026 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.138998    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 16 09:10:15.139156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.139083    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 16 09:10:15.139156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.139101    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 16 09:10:15.139276 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.139102    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 16 09:10:15.139965 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.139932    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 16 09:10:15.140156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.140134    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mzcd6\""
Jul 16 09:10:15.147044 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.147019    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 16 09:10:15.237720 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237671    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.237894 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237731    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.237894 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237765    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.237894 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237853    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.238048 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237914    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.238048 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.237977    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.238048 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.238000    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n94v\" (UniqueName: \"kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.338895 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338817    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.338895 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338882    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339119 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338910    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n94v\" (UniqueName: \"kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339119 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338951    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339119 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338975    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339119 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.338998    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339119 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.339025    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339860 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.339830    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.339978 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.339956    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.340035 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.339990    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.340265 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.340238    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.342054 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.342027    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.342156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.342068    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.347439 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.347415    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n94v\" (UniqueName: \"kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v\") pod \"console-6746448c8b-fm84g\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") " pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.448234 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.448199    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:15.629328 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.629296    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:10:15.633927 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:10:15.633897    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b8cef0_e2ae_4d4f_b1f7_912493189d0f.slice/crio-eae7c436eb2014d56e81af08b10a08a8242e0cf608af78cf78587e1746b7832f WatchSource:0}: Error finding container eae7c436eb2014d56e81af08b10a08a8242e0cf608af78cf78587e1746b7832f: Status 404 returned error can't find the container with id eae7c436eb2014d56e81af08b10a08a8242e0cf608af78cf78587e1746b7832f
Jul 16 09:10:15.832040 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:15.831995    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6746448c8b-fm84g" event={"ID":"63b8cef0-e2ae-4d4f-b1f7-912493189d0f","Type":"ContainerStarted","Data":"eae7c436eb2014d56e81af08b10a08a8242e0cf608af78cf78587e1746b7832f"}
Jul 16 09:10:18.108553 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:18.108511    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" podUID="713667ac-f671-46d8-90e0-e348af1bee41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 09:10:19.849949 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:19.849910    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6746448c8b-fm84g" event={"ID":"63b8cef0-e2ae-4d4f-b1f7-912493189d0f","Type":"ContainerStarted","Data":"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"}
Jul 16 09:10:19.867810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:19.867762    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6746448c8b-fm84g" podStartSLOduration=1.439586246 podStartE2EDuration="4.867747248s" totalImagesPullingTime="3.428161002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:10:19.867031291 +0000 UTC m=+317.560958734" watchObservedRunningTime="2026-07-16 09:10:19.867747248 +0000 UTC m=+317.561674689"
Jul 16 09:10:25.449363 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:25.449316    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:25.449888 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:25.449388    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:25.454061 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:25.454040    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:25.872299 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:25.872271    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:10:28.107977 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.107939    2550 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" podUID="713667ac-f671-46d8-90e0-e348af1bee41" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 16 09:10:28.108330 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.108003    2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6"
Jul 16 09:10:28.108478 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.108450    2550 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1e360cecd9f57e4cf9cb18142977d15a9605c26349384f8bd38424c9e00ae712"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 16 09:10:28.108526 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.108503    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" podUID="713667ac-f671-46d8-90e0-e348af1bee41" containerName="service-proxy" containerID="cri-o://1e360cecd9f57e4cf9cb18142977d15a9605c26349384f8bd38424c9e00ae712" gracePeriod=30
Jul 16 09:10:28.880142 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.880101    2550 generic.go:356] "Generic (PLEG): container finished" podID="713667ac-f671-46d8-90e0-e348af1bee41" containerID="1e360cecd9f57e4cf9cb18142977d15a9605c26349384f8bd38424c9e00ae712" exitCode=2
Jul 16 09:10:28.880305 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.880170    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerDied","Data":"1e360cecd9f57e4cf9cb18142977d15a9605c26349384f8bd38424c9e00ae712"}
Jul 16 09:10:28.880305 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:28.880209    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d74c8d8f-mr9w6" event={"ID":"713667ac-f671-46d8-90e0-e348af1bee41","Type":"ContainerStarted","Data":"ec31426d22d47dda6c3f5dfae566f00696fdcf20658447ef5f693ccae6ea6ff9"}
Jul 16 09:10:32.058667 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:10:32.058634    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfvv2_29df0134-df10-48d8-89d4-6885c4a17d1b/serve-healthcheck-canary/0.log"
Jul 16 09:11:16.601104 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:16.601015    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:11:16.603293 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:16.603267    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec102fe0-31ab-4f36-bd89-479b15643e15-metrics-certs\") pod \"network-metrics-daemon-9hhgz\" (UID: \"ec102fe0-31ab-4f36-bd89-479b15643e15\") " pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:11:16.861643 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:16.861618    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h777f\""
Jul 16 09:11:16.869446 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:16.869428    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hhgz"
Jul 16 09:11:16.993462 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:16.993429    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hhgz"]
Jul 16 09:11:16.998003 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:11:16.997981    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec102fe0_31ab_4f36_bd89_479b15643e15.slice/crio-c5f47d7be41048e223f5fb88186287be54405c39bdc1eef0413132d3103397d0 WatchSource:0}: Error finding container c5f47d7be41048e223f5fb88186287be54405c39bdc1eef0413132d3103397d0: Status 404 returned error can't find the container with id c5f47d7be41048e223f5fb88186287be54405c39bdc1eef0413132d3103397d0
Jul 16 09:11:17.036886 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:17.036851    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hhgz" event={"ID":"ec102fe0-31ab-4f36-bd89-479b15643e15","Type":"ContainerStarted","Data":"c5f47d7be41048e223f5fb88186287be54405c39bdc1eef0413132d3103397d0"}
Jul 16 09:11:18.041721 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:18.041669    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hhgz" event={"ID":"ec102fe0-31ab-4f36-bd89-479b15643e15","Type":"ContainerStarted","Data":"95c6f97fffc03c4aed0177156be64428d112897504b84d019f083cbbe629167e"}
Jul 16 09:11:18.042084 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:18.041734    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hhgz" event={"ID":"ec102fe0-31ab-4f36-bd89-479b15643e15","Type":"ContainerStarted","Data":"d03f0122af9219b132b6beb92d511e33fe929134cb6951cf6748a3f2cdd44d04"}
Jul 16 09:11:18.058452 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:18.058405    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9hhgz" podStartSLOduration=375.204658828 podStartE2EDuration="6m16.058388912s" totalImagesPullingTime="853.730084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:11:18.057063662 +0000 UTC m=+375.750991102" watchObservedRunningTime="2026-07-16 09:11:18.058388912 +0000 UTC m=+375.752316353"
Jul 16 09:11:46.197216 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:11:46.197182    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:12:11.216022 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.215957    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6746448c8b-fm84g" podUID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" containerName="console" containerID="cri-o://843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b" gracePeriod=15
Jul 16 09:12:11.447466 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.447442    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:12:11.581953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.581857    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.581953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.581902    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.581953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.581925    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n94v\" (UniqueName: \"kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.581953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.581944    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.582255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.581969    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.582255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582008    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.582255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582061    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle\") pod \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\" (UID: \"63b8cef0-e2ae-4d4f-b1f7-912493189d0f\") "
Jul 16 09:12:11.582476 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582441    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config" (OuterVolumeSpecName: "console-config") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:12:11.582610 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582443    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:12:11.582610 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582554    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:12:11.582610 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.582587    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:12:11.584268 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.584245    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:12:11.584349 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.584267    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:12:11.584349 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.584298    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v" (OuterVolumeSpecName: "kube-api-access-5n94v") pod "63b8cef0-e2ae-4d4f-b1f7-912493189d0f" (UID: "63b8cef0-e2ae-4d4f-b1f7-912493189d0f"). InnerVolumeSpecName "kube-api-access-5n94v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:12:11.682518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682478    2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-serving-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682512    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n94v\" (UniqueName: \"kubernetes.io/projected/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-kube-api-access-5n94v\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682518 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682526    2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-service-ca\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682785 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682539    2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-oauth-serving-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682785 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682550    2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-oauth-config\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682785 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682561    2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-trusted-ca-bundle\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:11.682785 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:11.682573    2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/63b8cef0-e2ae-4d4f-b1f7-912493189d0f-console-config\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:12:12.220693 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.220657    2550 generic.go:356] "Generic (PLEG): container finished" podID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" containerID="843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b" exitCode=0
Jul 16 09:12:12.221091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.220729    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6746448c8b-fm84g"
Jul 16 09:12:12.221091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.220732    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6746448c8b-fm84g" event={"ID":"63b8cef0-e2ae-4d4f-b1f7-912493189d0f","Type":"ContainerDied","Data":"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"}
Jul 16 09:12:12.221091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.220781    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6746448c8b-fm84g" event={"ID":"63b8cef0-e2ae-4d4f-b1f7-912493189d0f","Type":"ContainerDied","Data":"eae7c436eb2014d56e81af08b10a08a8242e0cf608af78cf78587e1746b7832f"}
Jul 16 09:12:12.221091 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.220803    2550 scope.go:117] "RemoveContainer" containerID="843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"
Jul 16 09:12:12.228850 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.228832    2550 scope.go:117] "RemoveContainer" containerID="843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"
Jul 16 09:12:12.229110 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:12:12.229092    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b\": container with ID starting with 843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b not found: ID does not exist" containerID="843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"
Jul 16 09:12:12.229173 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.229124    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b"} err="failed to get container status \"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b\": rpc error: code = NotFound desc = could not find container \"843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b\": container with ID starting with 843c3e31e240ad40e4a45caab3063d187d3296554c427324a0f53c8efb55bb3b not found: ID does not exist"
Jul 16 09:12:12.241546 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.241518    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:12:12.246619 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.246597    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6746448c8b-fm84g"]
Jul 16 09:12:12.862772 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:12:12.862737    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" path="/var/lib/kubelet/pods/63b8cef0-e2ae-4d4f-b1f7-912493189d0f/volumes"
Jul 16 09:14:40.989572 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.989534    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hg4f"]
Jul 16 09:14:40.990070 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.989838    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" containerName="console"
Jul 16 09:14:40.990070 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.989856    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" containerName="console"
Jul 16 09:14:40.990070 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.989934    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b8cef0-e2ae-4d4f-b1f7-912493189d0f" containerName="console"
Jul 16 09:14:40.991872 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.991849    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:40.994239 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.994207    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 09:14:40.994878 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.994859    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 09:14:40.994993 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:40.994864    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dx2j6\""
Jul 16 09:14:41.004835 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.004806    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hg4f"]
Jul 16 09:14:41.006235 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.006214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.006327 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.006243    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2dl9\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-kube-api-access-w2dl9\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.107122 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.107083    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.107122 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.107125    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2dl9\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-kube-api-access-w2dl9\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.115111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.115081    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.115224 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.115155    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2dl9\" (UniqueName: \"kubernetes.io/projected/bf5700f2-bb6e-4748-9f6f-9eae64268e06-kube-api-access-w2dl9\") pod \"cert-manager-55b4d954d5-8hg4f\" (UID: \"bf5700f2-bb6e-4748-9f6f-9eae64268e06\") " pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.306041 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.305943    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8hg4f"
Jul 16 09:14:41.427318 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.427246    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hg4f"]
Jul 16 09:14:41.430012 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:14:41.429988    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf5700f2_bb6e_4748_9f6f_9eae64268e06.slice/crio-ef0ca37d6ee01d2ae7095957bc281d21ca50817dc4a62440ef6a6086fd5d3f7e WatchSource:0}: Error finding container ef0ca37d6ee01d2ae7095957bc281d21ca50817dc4a62440ef6a6086fd5d3f7e: Status 404 returned error can't find the container with id ef0ca37d6ee01d2ae7095957bc281d21ca50817dc4a62440ef6a6086fd5d3f7e
Jul 16 09:14:41.708444 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:41.708407    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8hg4f" event={"ID":"bf5700f2-bb6e-4748-9f6f-9eae64268e06","Type":"ContainerStarted","Data":"ef0ca37d6ee01d2ae7095957bc281d21ca50817dc4a62440ef6a6086fd5d3f7e"}
Jul 16 09:14:44.720923 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:44.720888    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8hg4f" event={"ID":"bf5700f2-bb6e-4748-9f6f-9eae64268e06","Type":"ContainerStarted","Data":"270ee0fa876e670763b9e26dcc53821c445a34e4b987ac51d867ccbe349eb40c"}
Jul 16 09:14:44.735859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:14:44.735805    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8hg4f" podStartSLOduration=2.043436396 podStartE2EDuration="4.735790675s" totalImagesPullingTime="2.692354279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:14:44.735045458 +0000 UTC m=+582.428972900" watchObservedRunningTime="2026-07-16 09:14:44.735790675 +0000 UTC m=+582.429718116"
Jul 16 09:15:04.443997 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.443958    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"]
Jul 16 09:15:04.446926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.446904    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.449863 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.449833    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 09:15:04.450055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.450017    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 09:15:04.450149 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.450069    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 09:15:04.450149 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.450127    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m6hkx\""
Jul 16 09:15:04.450231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.450168    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 09:15:04.463784 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.463752    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.463936 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.463794    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2g5\" (UniqueName: \"kubernetes.io/projected/2afc2545-423a-4a2b-82bd-ed52977eedc1-kube-api-access-sk2g5\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.463936 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.463821    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.463936 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.463869    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.463936 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.463892    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.468558 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.468519    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"]
Jul 16 09:15:04.565031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.564989    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2g5\" (UniqueName: \"kubernetes.io/projected/2afc2545-423a-4a2b-82bd-ed52977eedc1-kube-api-access-sk2g5\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.565031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.565036    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.565286 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.565073    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.565286 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.565107    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.565286 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.565137    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.565522 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.565502    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-manifests\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.567380 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.567358    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2afc2545-423a-4a2b-82bd-ed52977eedc1-tmp\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.567507 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.567490    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.567588 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.567572    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2afc2545-423a-4a2b-82bd-ed52977eedc1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.578807 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.578779    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2g5\" (UniqueName: \"kubernetes.io/projected/2afc2545-423a-4a2b-82bd-ed52977eedc1-kube-api-access-sk2g5\") pod \"opendatahub-operator-controller-manager-6d64bd87c6-mv68z\" (UID: \"2afc2545-423a-4a2b-82bd-ed52977eedc1\") " pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.757695 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.757607    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:04.897057 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:04.896965    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"]
Jul 16 09:15:04.899672 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:15:04.899646    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afc2545_423a_4a2b_82bd_ed52977eedc1.slice/crio-f1091024a5d1f0fda7387f01d2772042910ad32680ecccf8c4315b5be9e50df6 WatchSource:0}: Error finding container f1091024a5d1f0fda7387f01d2772042910ad32680ecccf8c4315b5be9e50df6: Status 404 returned error can't find the container with id f1091024a5d1f0fda7387f01d2772042910ad32680ecccf8c4315b5be9e50df6
Jul 16 09:15:05.793955 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:05.793908    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z" event={"ID":"2afc2545-423a-4a2b-82bd-ed52977eedc1","Type":"ContainerStarted","Data":"f1091024a5d1f0fda7387f01d2772042910ad32680ecccf8c4315b5be9e50df6"}
Jul 16 09:15:08.807526 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:08.807487    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z" event={"ID":"2afc2545-423a-4a2b-82bd-ed52977eedc1","Type":"ContainerStarted","Data":"de84f2d7bf3942d7c26962463840b4fb1bc4bbca072b9345e87e37d61ab14cf3"}
Jul 16 09:15:09.812758 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:09.812664    2550 generic.go:356] "Generic (PLEG): container finished" podID="2afc2545-423a-4a2b-82bd-ed52977eedc1" containerID="de84f2d7bf3942d7c26962463840b4fb1bc4bbca072b9345e87e37d61ab14cf3" exitCode=0
Jul 16 09:15:09.812758 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:09.812738    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z" event={"ID":"2afc2545-423a-4a2b-82bd-ed52977eedc1","Type":"ContainerDied","Data":"de84f2d7bf3942d7c26962463840b4fb1bc4bbca072b9345e87e37d61ab14cf3"}
Jul 16 09:15:09.813194 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:09.813179    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:15:10.818370 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:10.818326    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z" event={"ID":"2afc2545-423a-4a2b-82bd-ed52977eedc1","Type":"ContainerStarted","Data":"09d86be6a27dacb070254f3ca10088c5717e1391225d3f4bd1b935ee72e300eb"}
Jul 16 09:15:10.818884 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:10.818511    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:10.840520 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:10.840460    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z" podStartSLOduration=1.837585163 podStartE2EDuration="6.840443291s" totalImagesPullingTime="3.966189213s" totalInitContainerRuntime="1.036668915s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:10.839045663 +0000 UTC m=+608.532973105" watchObservedRunningTime="2026-07-16 09:15:10.840443291 +0000 UTC m=+608.534370800"
Jul 16 09:15:21.824530 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:21.824494    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d64bd87c6-mv68z"
Jul 16 09:15:25.812154 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.812071    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"]
Jul 16 09:15:25.820933 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.820911    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:25.827589 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.827569    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 09:15:25.828694 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.828672    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 09:15:25.828783 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.828766    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 09:15:25.828825 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.828782    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 09:15:25.828905 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.828893    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vmzc6\""
Jul 16 09:15:25.853834 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.853808    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"]
Jul 16 09:15:25.925247 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.925183    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:25.925452 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.925366    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c4l\" (UniqueName: \"kubernetes.io/projected/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-kube-api-access-x4c4l\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:25.925452 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:25.925410    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.026766 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.026724    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.026968 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.026790    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c4l\" (UniqueName: \"kubernetes.io/projected/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-kube-api-access-x4c4l\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.026968 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.026809    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.029056 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.029026    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tmp\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.029218 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.029200    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-tls-certs\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.045695 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.045670    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c4l\" (UniqueName: \"kubernetes.io/projected/5c1dced4-a2b7-40df-99fc-8dfd6267d0e5-kube-api-access-x4c4l\") pod \"kube-auth-proxy-86ccb4d5cb-nzgvg\" (UID: \"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5\") " pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.129233 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.129200    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"
Jul 16 09:15:26.260837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.260680    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg"]
Jul 16 09:15:26.263356 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:15:26.263328    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1dced4_a2b7_40df_99fc_8dfd6267d0e5.slice/crio-e8486b5ffdbefadd13d0f191a72d7ad8af85aa5edb46bc06c3109083c12039a7 WatchSource:0}: Error finding container e8486b5ffdbefadd13d0f191a72d7ad8af85aa5edb46bc06c3109083c12039a7: Status 404 returned error can't find the container with id e8486b5ffdbefadd13d0f191a72d7ad8af85aa5edb46bc06c3109083c12039a7
Jul 16 09:15:26.872293 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:26.872259    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg" event={"ID":"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5","Type":"ContainerStarted","Data":"e8486b5ffdbefadd13d0f191a72d7ad8af85aa5edb46bc06c3109083c12039a7"}
Jul 16 09:15:29.885488 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:29.885449    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg" event={"ID":"5c1dced4-a2b7-40df-99fc-8dfd6267d0e5","Type":"ContainerStarted","Data":"831814ede1d6587bc5896753f4698896f04f1acc5a5ac5021679741344a03fc3"}
Jul 16 09:15:29.908409 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:29.908343    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86ccb4d5cb-nzgvg" podStartSLOduration=2.1720353709999998 podStartE2EDuration="4.908324257s" totalImagesPullingTime="2.736288886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:29.908031623 +0000 UTC m=+627.601959079" watchObservedRunningTime="2026-07-16 09:15:29.908324257 +0000 UTC m=+627.602251699"
Jul 16 09:15:32.872168 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.872134    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"]
Jul 16 09:15:32.875230 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.875210    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.877485 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.877462    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-w6d4l\""
Jul 16 09:15:32.877596 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.877485    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 09:15:32.891618 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.891584    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"]
Jul 16 09:15:32.984447 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984417    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984593 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984455    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984593 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984540    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984593 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984573    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwcpt\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-kube-api-access-dwcpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984783 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984646    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984783 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984694    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984783 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984758    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984785    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:32.984882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:32.984822    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.085825 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085785    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.085825 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085826    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085851    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085870    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085892    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085932    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085956    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.085990    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086068 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086019    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwcpt\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-kube-api-access-dwcpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086388 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086206    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086388 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086258    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086544 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086523    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086588 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086549    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.086764 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.086748    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.088238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.088207    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.088440 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.088418    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.097141 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.097121    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.107887 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.107864    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwcpt\" (UniqueName: \"kubernetes.io/projected/70b6f6fc-fecf-48d0-85e7-b96a7165e16c-kube-api-access-dwcpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r86mk\" (UID: \"70b6f6fc-fecf-48d0-85e7-b96a7165e16c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.184474 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.184393    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:33.313512 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.313422    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"]
Jul 16 09:15:33.316010 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:15:33.315978    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b6f6fc_fecf_48d0_85e7_b96a7165e16c.slice/crio-1c1815e2acdf2bb68295608c29eeaa93530821005dd25ce4c44b7aae673596a5 WatchSource:0}: Error finding container 1c1815e2acdf2bb68295608c29eeaa93530821005dd25ce4c44b7aae673596a5: Status 404 returned error can't find the container with id 1c1815e2acdf2bb68295608c29eeaa93530821005dd25ce4c44b7aae673596a5
Jul 16 09:15:33.900066 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:33.900029    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk" event={"ID":"70b6f6fc-fecf-48d0-85e7-b96a7165e16c","Type":"ContainerStarted","Data":"1c1815e2acdf2bb68295608c29eeaa93530821005dd25ce4c44b7aae673596a5"}
Jul 16 09:15:34.235842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.235753    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"]
Jul 16 09:15:34.239067 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.239035    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.243666 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243641    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 09:15:34.243666 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243667    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 09:15:34.243858 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243682    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 09:15:34.243858 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243805    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 09:15:34.243970 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243884    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 09:15:34.243970 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.243962    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tnmk8\""
Jul 16 09:15:34.250059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.250038    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"]
Jul 16 09:15:34.294877 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.294848    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-metrics-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.295072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.294885    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.295072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.294914    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t77j\" (UniqueName: \"kubernetes.io/projected/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-kube-api-access-5t77j\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.295169 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.295068    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-manager-config\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.396315 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.396277    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-manager-config\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.396315 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.396320    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-metrics-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.396576 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.396339    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.396576 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.396400    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t77j\" (UniqueName: \"kubernetes.io/projected/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-kube-api-access-5t77j\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.397220 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.397197    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-manager-config\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.399158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.399116    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-metrics-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.399158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.399123    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-cert\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.406483 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.406439    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t77j\" (UniqueName: \"kubernetes.io/projected/6bbc26f1-4eb7-4711-97a6-922cc5b8cdea-kube-api-access-5t77j\") pod \"lws-controller-manager-6ddb4bcd65-69dm2\" (UID: \"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea\") " pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:34.551061 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:34.550972    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:35.555204 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.555168    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:15:35.555468 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.555238    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:15:35.555468 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.555270    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:15:35.617195 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.617171    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"]
Jul 16 09:15:35.619565 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:15:35.619533    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bbc26f1_4eb7_4711_97a6_922cc5b8cdea.slice/crio-82c342c371c7bf8511cd9de008d0d0001284548fc361aeb189e70cb691aa50c3 WatchSource:0}: Error finding container 82c342c371c7bf8511cd9de008d0d0001284548fc361aeb189e70cb691aa50c3: Status 404 returned error can't find the container with id 82c342c371c7bf8511cd9de008d0d0001284548fc361aeb189e70cb691aa50c3
Jul 16 09:15:35.913403 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.913361    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk" event={"ID":"70b6f6fc-fecf-48d0-85e7-b96a7165e16c","Type":"ContainerStarted","Data":"c32df9616b242f533348829ff1243dc3748b0d43144240b34c00374eb2047cf2"}
Jul 16 09:15:35.914678 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:35.914651    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2" event={"ID":"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea","Type":"ContainerStarted","Data":"82c342c371c7bf8511cd9de008d0d0001284548fc361aeb189e70cb691aa50c3"}
Jul 16 09:15:36.185335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:36.185240    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:36.191469 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:36.191436    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:36.222514 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:36.222443    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk" podStartSLOduration=1.9854859569999999 podStartE2EDuration="4.222416175s" totalImagesPullingTime="2.236930218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:35.951053722 +0000 UTC m=+633.644981162" watchObservedRunningTime="2026-07-16 09:15:36.222416175 +0000 UTC m=+633.916343619"
Jul 16 09:15:36.918782 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:36.918751    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:36.919872 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:36.919849    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r86mk"
Jul 16 09:15:37.923074 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:37.923027    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2" event={"ID":"6bbc26f1-4eb7-4711-97a6-922cc5b8cdea","Type":"ContainerStarted","Data":"ce79b5fe937e30872f60d0c6a36cf5490df4da7696115914e0f0d8626acdeded"}
Jul 16 09:15:37.945419 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:37.945371    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2" podStartSLOduration=1.965947931 podStartE2EDuration="3.945357597s" totalImagesPullingTime="1.979409666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:37.94339504 +0000 UTC m=+635.637322481" watchObservedRunningTime="2026-07-16 09:15:37.945357597 +0000 UTC m=+635.639285037"
Jul 16 09:15:38.926199 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:38.926169    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:15:49.931430 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:15:49.931399    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ddb4bcd65-69dm2"
Jul 16 09:17:53.572232 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.572204    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"]
Jul 16 09:17:53.575176 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.575160    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.577585 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.577556    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gfqb6\""
Jul 16 09:17:53.587372 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.587349    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"]
Jul 16 09:17:53.593256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593230    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593359 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593265    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593359 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593287    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-kube-api-access-jm2gx\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593359 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593342    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593359 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593356    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593569 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593377    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593569 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593430    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593569 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593457    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.593569 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.593476    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694088 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694059    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694099    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694124    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-kube-api-access-jm2gx\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694164    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694185    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694216    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694454 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694256    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694454 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694279    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694454 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694305    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694651 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694617    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694651 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694636    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694812 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694662    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.694812 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.694726    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.695296 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.695273    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.696434 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.696406    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.696601 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.696582    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.702617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.702593    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.702915 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.702896    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm2gx\" (UniqueName: \"kubernetes.io/projected/f5e0d2ee-a73b-46a3-94ab-a6f607804af9-kube-api-access-jm2gx\") pod \"maas-default-gateway-openshift-default-56654dcf7-r58rl\" (UID: \"f5e0d2ee-a73b-46a3-94ab-a6f607804af9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:53.884498 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:53.884469    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:54.008673 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.008636    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"]
Jul 16 09:17:54.011449 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:17:54.011426    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e0d2ee_a73b_46a3_94ab_a6f607804af9.slice/crio-96383653f33264f6bf3030f848f90cc441d30cc50055c5a0d301ea47d25a1f9e WatchSource:0}: Error finding container 96383653f33264f6bf3030f848f90cc441d30cc50055c5a0d301ea47d25a1f9e: Status 404 returned error can't find the container with id 96383653f33264f6bf3030f848f90cc441d30cc50055c5a0d301ea47d25a1f9e
Jul 16 09:17:54.013452 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.013411    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:17:54.013533 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.013470    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:17:54.013533 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.013495    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:17:54.392770 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.392736    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" event={"ID":"f5e0d2ee-a73b-46a3-94ab-a6f607804af9","Type":"ContainerStarted","Data":"7183534b6f4136535de7af7060eaf4bf92742c1da32831aa2d2d14bc0abaa166"}
Jul 16 09:17:54.392919 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.392792    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" event={"ID":"f5e0d2ee-a73b-46a3-94ab-a6f607804af9","Type":"ContainerStarted","Data":"96383653f33264f6bf3030f848f90cc441d30cc50055c5a0d301ea47d25a1f9e"}
Jul 16 09:17:54.418922 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.418874    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" podStartSLOduration=1.418859766 podStartE2EDuration="1.418859766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:17:54.416928897 +0000 UTC m=+772.110856338" watchObservedRunningTime="2026-07-16 09:17:54.418859766 +0000 UTC m=+772.112787207"
Jul 16 09:17:54.885057 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:54.885031    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:55.889854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:55.889826    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:56.399609 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:56.399580    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:17:56.400534 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:17:56.400517    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:18:07.503550 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.503516    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:07.506819 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.506802    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:07.509141 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.509123    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 09:18:07.509786 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.509769    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2t9c2\""
Jul 16 09:18:07.509883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.509773    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 09:18:07.519241 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.519221    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:07.590266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.590244    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4nn\" (UniqueName: \"kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn\") pod \"authorino-75d556bd77-qncm9\" (UID: \"39a07bfe-e2d3-4673-93ac-8a53361996c3\") " pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:07.690670 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.690646    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4nn\" (UniqueName: \"kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn\") pod \"authorino-75d556bd77-qncm9\" (UID: \"39a07bfe-e2d3-4673-93ac-8a53361996c3\") " pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:07.698897 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.698878    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4nn\" (UniqueName: \"kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn\") pod \"authorino-75d556bd77-qncm9\" (UID: \"39a07bfe-e2d3-4673-93ac-8a53361996c3\") " pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:07.814763 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.814712    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:07.938095 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:07.938065    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:07.941135 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:18:07.941111    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39a07bfe_e2d3_4673_93ac_8a53361996c3.slice/crio-12145ff78598e0bbac94c61b4fe78960d5f032d36581ea6c0ecb6e770413a928 WatchSource:0}: Error finding container 12145ff78598e0bbac94c61b4fe78960d5f032d36581ea6c0ecb6e770413a928: Status 404 returned error can't find the container with id 12145ff78598e0bbac94c61b4fe78960d5f032d36581ea6c0ecb6e770413a928
Jul 16 09:18:08.443968 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:08.443937    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qncm9" event={"ID":"39a07bfe-e2d3-4673-93ac-8a53361996c3","Type":"ContainerStarted","Data":"12145ff78598e0bbac94c61b4fe78960d5f032d36581ea6c0ecb6e770413a928"}
Jul 16 09:18:12.463460 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:12.463418    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qncm9" event={"ID":"39a07bfe-e2d3-4673-93ac-8a53361996c3","Type":"ContainerStarted","Data":"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"}
Jul 16 09:18:12.477391 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:12.477325    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-qncm9" podStartSLOduration=1.906174782 podStartE2EDuration="5.477305631s" totalImagesPullingTime="3.571130849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:18:12.476920316 +0000 UTC m=+790.170847758" watchObservedRunningTime="2026-07-16 09:18:12.477305631 +0000 UTC m=+790.171233072"
Jul 16 09:18:40.322879 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.322850    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58f96bc6b5-npp7b"]
Jul 16 09:18:40.328521 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.328505    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.333604 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.333582    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58f96bc6b5-npp7b"]
Jul 16 09:18:40.418727 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.418685    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t5xg\" (UniqueName: \"kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg\") pod \"authorino-58f96bc6b5-npp7b\" (UID: \"82630138-223a-4f24-93b5-514025695fc9\") " pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.447821 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.447796    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f96bc6b5-npp7b"]
Jul 16 09:18:40.447957 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:18:40.447940    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8t5xg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-58f96bc6b5-npp7b" podUID="82630138-223a-4f24-93b5-514025695fc9"
Jul 16 09:18:40.474407 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.474386    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:18:40.477529 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.477515    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.479731 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.479713    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 09:18:40.487253 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.487232    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:18:40.519018 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.519000    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t5xg\" (UniqueName: \"kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg\") pod \"authorino-58f96bc6b5-npp7b\" (UID: \"82630138-223a-4f24-93b5-514025695fc9\") " pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.527421 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.527393    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t5xg\" (UniqueName: \"kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg\") pod \"authorino-58f96bc6b5-npp7b\" (UID: \"82630138-223a-4f24-93b5-514025695fc9\") " pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.570021 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.569996    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.576882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.576837    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:40.620070 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.620049    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.620158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.620076    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f562k\" (UniqueName: \"kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.720583 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.720563    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t5xg\" (UniqueName: \"kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg\") pod \"82630138-223a-4f24-93b5-514025695fc9\" (UID: \"82630138-223a-4f24-93b5-514025695fc9\") "
Jul 16 09:18:40.720663 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.720631    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.720663 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.720651    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f562k\" (UniqueName: \"kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.722480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.722453    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg" (OuterVolumeSpecName: "kube-api-access-8t5xg") pod "82630138-223a-4f24-93b5-514025695fc9" (UID: "82630138-223a-4f24-93b5-514025695fc9"). InnerVolumeSpecName "kube-api-access-8t5xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:18:40.722793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.722778    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.727809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.727783    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f562k\" (UniqueName: \"kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k\") pod \"authorino-c5cf8d68f-jm9gj\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") " pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.784991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.784975    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:18:40.821305 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.821065    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t5xg\" (UniqueName: \"kubernetes.io/projected/82630138-223a-4f24-93b5-514025695fc9-kube-api-access-8t5xg\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:18:40.906396 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:40.906370    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:18:40.909506 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:18:40.909479    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode76d4c5a_66af_4d92_8230_1f739f8234a1.slice/crio-757723c9b78959e490f3f03305de3790e8712f70373276b9a0574ca7bec489a3 WatchSource:0}: Error finding container 757723c9b78959e490f3f03305de3790e8712f70373276b9a0574ca7bec489a3: Status 404 returned error can't find the container with id 757723c9b78959e490f3f03305de3790e8712f70373276b9a0574ca7bec489a3
Jul 16 09:18:41.575915 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.575878    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" event={"ID":"e76d4c5a-66af-4d92-8230-1f739f8234a1","Type":"ContainerStarted","Data":"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"}
Jul 16 09:18:41.576257 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.575922    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" event={"ID":"e76d4c5a-66af-4d92-8230-1f739f8234a1","Type":"ContainerStarted","Data":"757723c9b78959e490f3f03305de3790e8712f70373276b9a0574ca7bec489a3"}
Jul 16 09:18:41.576257 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.575890    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58f96bc6b5-npp7b"
Jul 16 09:18:41.595650 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.595604    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" podStartSLOduration=1.08832076 podStartE2EDuration="1.595590353s" totalImagesPullingTime="507.269593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:18:41.5940989 +0000 UTC m=+819.288026362" watchObservedRunningTime="2026-07-16 09:18:41.595590353 +0000 UTC m=+819.289517793"
Jul 16 09:18:41.619211 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.619181    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58f96bc6b5-npp7b"]
Jul 16 09:18:41.622662 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.622636    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:41.622828 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.622808    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-qncm9" podUID="39a07bfe-e2d3-4673-93ac-8a53361996c3" containerName="authorino" containerID="cri-o://d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4" gracePeriod=30
Jul 16 09:18:41.631185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.631161    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58f96bc6b5-npp7b"]
Jul 16 09:18:41.857830 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.857805    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:41.929524 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.929497    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp4nn\" (UniqueName: \"kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn\") pod \"39a07bfe-e2d3-4673-93ac-8a53361996c3\" (UID: \"39a07bfe-e2d3-4673-93ac-8a53361996c3\") "
Jul 16 09:18:41.931501 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:41.931473    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn" (OuterVolumeSpecName: "kube-api-access-xp4nn") pod "39a07bfe-e2d3-4673-93ac-8a53361996c3" (UID: "39a07bfe-e2d3-4673-93ac-8a53361996c3"). InnerVolumeSpecName "kube-api-access-xp4nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:18:42.030769 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.030687    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp4nn\" (UniqueName: \"kubernetes.io/projected/39a07bfe-e2d3-4673-93ac-8a53361996c3-kube-api-access-xp4nn\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:18:42.580326 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.580300    2550 generic.go:356] "Generic (PLEG): container finished" podID="39a07bfe-e2d3-4673-93ac-8a53361996c3" containerID="d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4" exitCode=0
Jul 16 09:18:42.580721 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.580336    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-qncm9"
Jul 16 09:18:42.580721 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.580365    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qncm9" event={"ID":"39a07bfe-e2d3-4673-93ac-8a53361996c3","Type":"ContainerDied","Data":"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"}
Jul 16 09:18:42.580721 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.580394    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-qncm9" event={"ID":"39a07bfe-e2d3-4673-93ac-8a53361996c3","Type":"ContainerDied","Data":"12145ff78598e0bbac94c61b4fe78960d5f032d36581ea6c0ecb6e770413a928"}
Jul 16 09:18:42.580721 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.580410    2550 scope.go:117] "RemoveContainer" containerID="d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"
Jul 16 09:18:42.587827 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.587810    2550 scope.go:117] "RemoveContainer" containerID="d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"
Jul 16 09:18:42.588086 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:18:42.588067    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4\": container with ID starting with d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4 not found: ID does not exist" containerID="d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"
Jul 16 09:18:42.588133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.588093    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4"} err="failed to get container status \"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4\": rpc error: code = NotFound desc = could not find container \"d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4\": container with ID starting with d24eae769a7dd6f229aea485530a151f2d9afe619a3c9ec570b8b9af1e6c46d4 not found: ID does not exist"
Jul 16 09:18:42.600220 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.600200    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:42.604166 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.604146    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-qncm9"]
Jul 16 09:18:42.867943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.867920    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a07bfe-e2d3-4673-93ac-8a53361996c3" path="/var/lib/kubelet/pods/39a07bfe-e2d3-4673-93ac-8a53361996c3/volumes"
Jul 16 09:18:42.868205 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:18:42.868193    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82630138-223a-4f24-93b5-514025695fc9" path="/var/lib/kubelet/pods/82630138-223a-4f24-93b5-514025695fc9/volumes"
Jul 16 09:19:30.766135 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.766101    2550 generic.go:356] "Generic (PLEG): container finished" podID="f5e0d2ee-a73b-46a3-94ab-a6f607804af9" containerID="7183534b6f4136535de7af7060eaf4bf92742c1da32831aa2d2d14bc0abaa166" exitCode=0
Jul 16 09:19:30.766526 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.766177    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" event={"ID":"f5e0d2ee-a73b-46a3-94ab-a6f607804af9","Type":"ContainerDied","Data":"7183534b6f4136535de7af7060eaf4bf92742c1da32831aa2d2d14bc0abaa166"}
Jul 16 09:19:30.766596 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.766582    2550 scope.go:117] "RemoveContainer" containerID="7183534b6f4136535de7af7060eaf4bf92742c1da32831aa2d2d14bc0abaa166"
Jul 16 09:19:30.767499 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.767475    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:19:30.767547 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.767538    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:19:30.767579 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:30.767567    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:19:31.773630 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:31.773595    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" event={"ID":"f5e0d2ee-a73b-46a3-94ab-a6f607804af9","Type":"ContainerStarted","Data":"879ac335ee99ca01fb28640dfa00e0fe79ef56b24e3ee58a7f72d3b091b146fa"}
Jul 16 09:19:31.885413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:31.885379    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:19:31.885607 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:31.885587    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r58rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 16 09:19:31.885653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:31.885632    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" podUID="f5e0d2ee-a73b-46a3-94ab-a6f607804af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 16 09:19:32.885374 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:32.885342    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r58rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 16 09:19:32.885774 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:32.885395    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" podUID="f5e0d2ee-a73b-46a3-94ab-a6f607804af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 16 09:19:33.885137 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:33.885093    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r58rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 16 09:19:33.885316 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:33.885169    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" podUID="f5e0d2ee-a73b-46a3-94ab-a6f607804af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 16 09:19:34.885449 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:34.885412    2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r58rl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused" start-of-body=
Jul 16 09:19:34.885855 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:34.885478    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl" podUID="f5e0d2ee-a73b-46a3-94ab-a6f607804af9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.19:15021/healthz/ready\": dial tcp 10.133.0.19:15021: connect: connection refused"
Jul 16 09:19:35.888752 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:35.888720    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:19:35.889172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:35.889036    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:19:35.889794 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:19:35.889773    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r58rl"
Jul 16 09:21:02.966393 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.966361    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"]
Jul 16 09:21:02.966845 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.966631    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a07bfe-e2d3-4673-93ac-8a53361996c3" containerName="authorino"
Jul 16 09:21:02.966845 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.966642    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a07bfe-e2d3-4673-93ac-8a53361996c3" containerName="authorino"
Jul 16 09:21:02.966845 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.966726    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a07bfe-e2d3-4673-93ac-8a53361996c3" containerName="authorino"
Jul 16 09:21:02.969260 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.969243    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.971646 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.971624    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 09:21:02.972365 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.972349    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 09:21:02.972365 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.972357    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 16 09:21:02.972500 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.972411    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5qshb\""
Jul 16 09:21:02.978050 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.978029    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"]
Jul 16 09:21:02.988508 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988490    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab4a994-452d-4149-b8a7-4789131f11b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.988615 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988521    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.988615 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988590    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.988734 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988649    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.988734 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988677    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dmhc\" (UniqueName: \"kubernetes.io/projected/aab4a994-452d-4149-b8a7-4789131f11b7-kube-api-access-4dmhc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:02.988828 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:02.988739    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.089933 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.089910    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090033 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.089940    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dmhc\" (UniqueName: \"kubernetes.io/projected/aab4a994-452d-4149-b8a7-4789131f11b7-kube-api-access-4dmhc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090033 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.089958    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090033 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.089985    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab4a994-452d-4149-b8a7-4789131f11b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090033 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.090012    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090239 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.090064    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090342 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.090323    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090402 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.090329    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.090438 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.090420    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.091976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.091954    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aab4a994-452d-4149-b8a7-4789131f11b7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.092266 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.092251    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aab4a994-452d-4149-b8a7-4789131f11b7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.098523 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.098502    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dmhc\" (UniqueName: \"kubernetes.io/projected/aab4a994-452d-4149-b8a7-4789131f11b7-kube-api-access-4dmhc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw\" (UID: \"aab4a994-452d-4149-b8a7-4789131f11b7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.279083 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.279009    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:03.405925 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.405896    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"]
Jul 16 09:21:03.409189 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:21:03.409155    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaab4a994_452d_4149_b8a7_4789131f11b7.slice/crio-890e63c8e93cdbd8b727f58c5c3002fb4c3145ca8e19927e556b78b5c302e41e WatchSource:0}: Error finding container 890e63c8e93cdbd8b727f58c5c3002fb4c3145ca8e19927e556b78b5c302e41e: Status 404 returned error can't find the container with id 890e63c8e93cdbd8b727f58c5c3002fb4c3145ca8e19927e556b78b5c302e41e
Jul 16 09:21:03.410814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:03.410792    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:21:04.142446 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:04.142412    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw" event={"ID":"aab4a994-452d-4149-b8a7-4789131f11b7","Type":"ContainerStarted","Data":"890e63c8e93cdbd8b727f58c5c3002fb4c3145ca8e19927e556b78b5c302e41e"}
Jul 16 09:21:05.148233 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:05.148185    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw" event={"ID":"aab4a994-452d-4149-b8a7-4789131f11b7","Type":"ContainerStarted","Data":"75409d3d8ace836fb448980d6f199ff1c0429a32fedc04616d67e905b6148e2f"}
Jul 16 09:21:05.166325 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:05.166272    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw" podStartSLOduration=2.187001166 podStartE2EDuration="3.166258191s" totalImagesPullingTime="979.257025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:21:05.165425178 +0000 UTC m=+962.859352631" watchObservedRunningTime="2026-07-16 09:21:05.166258191 +0000 UTC m=+962.860185632"
Jul 16 09:21:13.279823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:13.279775    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:13.279823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:13.279832    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:13.291982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:13.291953    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:21:14.195209 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:21:14.195178    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw"
Jul 16 09:22:16.714953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.714914    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85985554b8-5f45f"]
Jul 16 09:22:16.718160 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.718139    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.726171 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.726140    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85985554b8-5f45f"]
Jul 16 09:22:16.779874 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.779824    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-tls-cert\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.780036 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.779878    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg85h\" (UniqueName: \"kubernetes.io/projected/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-kube-api-access-cg85h\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.880752 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.880714    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-tls-cert\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.880752 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.880755    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg85h\" (UniqueName: \"kubernetes.io/projected/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-kube-api-access-cg85h\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.883279 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.883244    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-tls-cert\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:16.889328 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:16.889303    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg85h\" (UniqueName: \"kubernetes.io/projected/4ab84b8c-8e05-4061-b1e6-9aa7211de94b-kube-api-access-cg85h\") pod \"authorino-85985554b8-5f45f\" (UID: \"4ab84b8c-8e05-4061-b1e6-9aa7211de94b\") " pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:17.027833 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:17.027732    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85985554b8-5f45f"
Jul 16 09:22:17.152939 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:17.152916    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85985554b8-5f45f"]
Jul 16 09:22:17.155259 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:22:17.155235    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ab84b8c_8e05_4061_b1e6_9aa7211de94b.slice/crio-864f596f4df42e95f602c54dd65ac50e6074d4386f07afd83f4c50e4fa5aa24f WatchSource:0}: Error finding container 864f596f4df42e95f602c54dd65ac50e6074d4386f07afd83f4c50e4fa5aa24f: Status 404 returned error can't find the container with id 864f596f4df42e95f602c54dd65ac50e6074d4386f07afd83f4c50e4fa5aa24f
Jul 16 09:22:17.432713 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:17.432675    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85985554b8-5f45f" event={"ID":"4ab84b8c-8e05-4061-b1e6-9aa7211de94b","Type":"ContainerStarted","Data":"864f596f4df42e95f602c54dd65ac50e6074d4386f07afd83f4c50e4fa5aa24f"}
Jul 16 09:22:18.440457 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.440407    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85985554b8-5f45f" event={"ID":"4ab84b8c-8e05-4061-b1e6-9aa7211de94b","Type":"ContainerStarted","Data":"0220eac7fb91e824ab33bc71770e3f98900ee04a73a2b05465e15d77ff52d972"}
Jul 16 09:22:18.477020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.476961    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85985554b8-5f45f" podStartSLOduration=1.996111618 podStartE2EDuration="2.476940775s" totalImagesPullingTime="480.829157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:22:18.475291472 +0000 UTC m=+1036.169218945" watchObservedRunningTime="2026-07-16 09:22:18.476940775 +0000 UTC m=+1036.170868217"
Jul 16 09:22:18.526636 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.526593    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:22:18.526843 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.526791    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" podUID="e76d4c5a-66af-4d92-8230-1f739f8234a1" containerName="authorino" containerID="cri-o://b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118" gracePeriod=30
Jul 16 09:22:18.779098 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.779073    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:22:18.903482 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.903445    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f562k\" (UniqueName: \"kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k\") pod \"e76d4c5a-66af-4d92-8230-1f739f8234a1\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") "
Jul 16 09:22:18.903672 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.903548    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert\") pod \"e76d4c5a-66af-4d92-8230-1f739f8234a1\" (UID: \"e76d4c5a-66af-4d92-8230-1f739f8234a1\") "
Jul 16 09:22:18.905810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.905776    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k" (OuterVolumeSpecName: "kube-api-access-f562k") pod "e76d4c5a-66af-4d92-8230-1f739f8234a1" (UID: "e76d4c5a-66af-4d92-8230-1f739f8234a1"). InnerVolumeSpecName "kube-api-access-f562k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:22:18.912900 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:18.912870    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e76d4c5a-66af-4d92-8230-1f739f8234a1" (UID: "e76d4c5a-66af-4d92-8230-1f739f8234a1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:22:19.004480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.004393    2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e76d4c5a-66af-4d92-8230-1f739f8234a1-tls-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:22:19.004480 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.004425    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f562k\" (UniqueName: \"kubernetes.io/projected/e76d4c5a-66af-4d92-8230-1f739f8234a1-kube-api-access-f562k\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:22:19.446002 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.445964    2550 generic.go:356] "Generic (PLEG): container finished" podID="e76d4c5a-66af-4d92-8230-1f739f8234a1" containerID="b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118" exitCode=0
Jul 16 09:22:19.446002 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.446002    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj"
Jul 16 09:22:19.446461 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.446038    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" event={"ID":"e76d4c5a-66af-4d92-8230-1f739f8234a1","Type":"ContainerDied","Data":"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"}
Jul 16 09:22:19.446461 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.446070    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c5cf8d68f-jm9gj" event={"ID":"e76d4c5a-66af-4d92-8230-1f739f8234a1","Type":"ContainerDied","Data":"757723c9b78959e490f3f03305de3790e8712f70373276b9a0574ca7bec489a3"}
Jul 16 09:22:19.446461 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.446089    2550 scope.go:117] "RemoveContainer" containerID="b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"
Jul 16 09:22:19.454159 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.454141    2550 scope.go:117] "RemoveContainer" containerID="b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"
Jul 16 09:22:19.454444 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:22:19.454423    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118\": container with ID starting with b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118 not found: ID does not exist" containerID="b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"
Jul 16 09:22:19.454530 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.454451    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118"} err="failed to get container status \"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118\": rpc error: code = NotFound desc = could not find container \"b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118\": container with ID starting with b21d1cbb55d6c3ba04715f4f594bd9890a317ab6feaccf88ec084b4478005118 not found: ID does not exist"
Jul 16 09:22:19.466605 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.466575    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:22:19.471935 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:19.471911    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c5cf8d68f-jm9gj"]
Jul 16 09:22:20.864236 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:22:20.864202    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e76d4c5a-66af-4d92-8230-1f739f8234a1" path="/var/lib/kubelet/pods/e76d4c5a-66af-4d92-8230-1f739f8234a1/volumes"
Jul 16 09:35:42.043486 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.043447    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:42.043937 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.043918    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e76d4c5a-66af-4d92-8230-1f739f8234a1" containerName="authorino"
Jul 16 09:35:42.043982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.043941    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e76d4c5a-66af-4d92-8230-1f739f8234a1" containerName="authorino"
Jul 16 09:35:42.044031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.044020    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e76d4c5a-66af-4d92-8230-1f739f8234a1" containerName="authorino"
Jul 16 09:35:42.047328 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.047307    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.049842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.049818    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5cefe74e-openshift-default-dockercfg-z8hwr\""
Jul 16 09:35:42.068227 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.068188    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:42.222288 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222223    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222288 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222303    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz56t\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222350    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222416    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222445    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222483    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222516    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222545    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.222586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.222586    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323628 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323523    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz56t\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323628 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323578    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323628 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323618    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323642    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323682    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323750    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323780    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323815    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.323953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.323845    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.324268 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.324238    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.324327 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.324276    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.324327 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.324314    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.324490 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.324451    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.324888 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.324861    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.326270 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.326248    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.326430 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.326412    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.336264 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.336223    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz56t\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.336264 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.336238    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token\") pod \"e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") " pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.358056 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.358018    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:42.527931 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.527893    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:42.530775 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:35:42.530685    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f9c358_a033_4c0e_b81d_be744c9e3b83.slice/crio-c06ffeb1ce10f01c8b5545dae26458f4bea81a810600a8752aec49b99254eab3 WatchSource:0}: Error finding container c06ffeb1ce10f01c8b5545dae26458f4bea81a810600a8752aec49b99254eab3: Status 404 returned error can't find the container with id c06ffeb1ce10f01c8b5545dae26458f4bea81a810600a8752aec49b99254eab3
Jul 16 09:35:42.532925 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.532888    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:35:42.533007 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.532981    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:35:42.533043 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.533013    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:35:42.687025 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.686971    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" event={"ID":"13f9c358-a033-4c0e-b81d-be744c9e3b83","Type":"ContainerStarted","Data":"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"}
Jul 16 09:35:42.687247 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.687061    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" event={"ID":"13f9c358-a033-4c0e-b81d-be744c9e3b83","Type":"ContainerStarted","Data":"c06ffeb1ce10f01c8b5545dae26458f4bea81a810600a8752aec49b99254eab3"}
Jul 16 09:35:42.707892 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:42.707809    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" podStartSLOduration=0.707779709 podStartE2EDuration="707.779709ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:35:42.705634151 +0000 UTC m=+1840.399561616" watchObservedRunningTime="2026-07-16 09:35:42.707779709 +0000 UTC m=+1840.401707152"
Jul 16 09:35:43.358931 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:43.358889    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:43.364447 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:43.364418    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:43.691589 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:43.691547    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:43.692724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:43.692679    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:48.334577 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:48.334539    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:48.335024 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:48.334758    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" podUID="13f9c358-a033-4c0e-b81d-be744c9e3b83" containerName="istio-proxy" containerID="cri-o://b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c" gracePeriod=30
Jul 16 09:35:54.692963 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.692929    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:54.736653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736612    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.736875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736694    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz56t\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.736875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736737    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.736875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736772    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.736875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736798    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.736875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736835    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.737111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736952    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.737111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736955    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:54.737111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.736997    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.737247 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.737120    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert\") pod \"13f9c358-a033-4c0e-b81d-be744c9e3b83\" (UID: \"13f9c358-a033-4c0e-b81d-be744c9e3b83\") "
Jul 16 09:35:54.737724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.737371    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:54.737724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.737450    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.737724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.737565    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:54.737724 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.737719    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:35:54.738136 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.738073    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data" (OuterVolumeSpecName: "istio-data") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:54.740005 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.739950    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:35:54.740118 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.739990    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t" (OuterVolumeSpecName: "kube-api-access-xz56t") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "kube-api-access-xz56t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:35:54.740158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.740128    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token" (OuterVolumeSpecName: "istio-token") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:35:54.740250 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.740229    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13f9c358-a033-4c0e-b81d-be744c9e3b83" (UID: "13f9c358-a033-4c0e-b81d-be744c9e3b83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:35:54.743017 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.742989    2550 generic.go:356] "Generic (PLEG): container finished" podID="13f9c358-a033-4c0e-b81d-be744c9e3b83" containerID="b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c" exitCode=0
Jul 16 09:35:54.743156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.743041    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"
Jul 16 09:35:54.743156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.743076    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" event={"ID":"13f9c358-a033-4c0e-b81d-be744c9e3b83","Type":"ContainerDied","Data":"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"}
Jul 16 09:35:54.743156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.743146    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t" event={"ID":"13f9c358-a033-4c0e-b81d-be744c9e3b83","Type":"ContainerDied","Data":"c06ffeb1ce10f01c8b5545dae26458f4bea81a810600a8752aec49b99254eab3"}
Jul 16 09:35:54.743300 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.743177    2550 scope.go:117] "RemoveContainer" containerID="b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"
Jul 16 09:35:54.759389 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.759363    2550 scope.go:117] "RemoveContainer" containerID="b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"
Jul 16 09:35:54.759881 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:35:54.759856    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c\": container with ID starting with b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c not found: ID does not exist" containerID="b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"
Jul 16 09:35:54.759968 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.759890    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c"} err="failed to get container status \"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c\": rpc error: code = NotFound desc = could not find container \"b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c\": container with ID starting with b5ff5e4cde0122a0b0aa1e3e8434bc53aca224a03810fce6af023aa29316ef7c not found: ID does not exist"
Jul 16 09:35:54.770275 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.770241    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:54.774283 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.774255    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5cefe74e-openshift-default-79dc8df47-kgm4t"]
Jul 16 09:35:54.838924 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838821    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13f9c358-a033-4c0e-b81d-be744c9e3b83-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.838924 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838855    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz56t\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-kube-api-access-xz56t\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.838924 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838923    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.839152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838941    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.839152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838952    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.839152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838963    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13f9c358-a033-4c0e-b81d-be744c9e3b83-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.839152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838973    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.839152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.838984    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13f9c358-a033-4c0e-b81d-be744c9e3b83-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:35:54.864291 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:35:54.864253    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13f9c358-a033-4c0e-b81d-be744c9e3b83" path="/var/lib/kubelet/pods/13f9c358-a033-4c0e-b81d-be744c9e3b83/volumes"
Jul 16 09:36:00.510689 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.510637    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:00.511145 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.511127    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f9c358-a033-4c0e-b81d-be744c9e3b83" containerName="istio-proxy"
Jul 16 09:36:00.511193 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.511149    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f9c358-a033-4c0e-b81d-be744c9e3b83" containerName="istio-proxy"
Jul 16 09:36:00.511274 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.511261    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="13f9c358-a033-4c0e-b81d-be744c9e3b83" containerName="istio-proxy"
Jul 16 09:36:00.514556 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.514532    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.516925 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.516897    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-878a849a-gw-openshift-default-dockercfg-lck28\""
Jul 16 09:36:00.527448 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.527420    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:00.592417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592376    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592417 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592432    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592537    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592567    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592617    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5brz\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592660 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592639    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592674    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592758    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.592859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.592828    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.693979 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.693931    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.693979 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.693980    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694023    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5brz\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694057    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694108    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694135    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694198    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694239    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694568 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694275    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694568 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694420    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694568 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694461    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694568 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694507    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694568 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694551    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.694892 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.694872    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.696773 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.696753    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.696918 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.696900    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.703438 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.703401    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.703624 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.703601    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5brz\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz\") pod \"e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") " pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.827561 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.827447    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:00.982321 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.982284    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:00.984796 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:36:00.984763    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd437e189_470f_4e7d_b4a5_6e7f013a4e17.slice/crio-c53d22623f70227d3b0e37c8fc4e8ef202687447ad87655fd86dee5e03c85ac2 WatchSource:0}: Error finding container c53d22623f70227d3b0e37c8fc4e8ef202687447ad87655fd86dee5e03c85ac2: Status 404 returned error can't find the container with id c53d22623f70227d3b0e37c8fc4e8ef202687447ad87655fd86dee5e03c85ac2
Jul 16 09:36:00.987616 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.987570    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:00.987743 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.987671    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:00.987810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:00.987743    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:01.773877 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:01.773836    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" event={"ID":"d437e189-470f-4e7d-b4a5-6e7f013a4e17","Type":"ContainerStarted","Data":"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"}
Jul 16 09:36:01.774393 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:01.773892    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" event={"ID":"d437e189-470f-4e7d-b4a5-6e7f013a4e17","Type":"ContainerStarted","Data":"c53d22623f70227d3b0e37c8fc4e8ef202687447ad87655fd86dee5e03c85ac2"}
Jul 16 09:36:01.793766 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:01.793693    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" podStartSLOduration=1.79365179 podStartE2EDuration="1.79365179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:01.792810824 +0000 UTC m=+1859.486738266" watchObservedRunningTime="2026-07-16 09:36:01.79365179 +0000 UTC m=+1859.487579288"
Jul 16 09:36:01.827847 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:01.827813    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:02.834006 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:02.833960    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:03.782662 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:03.782625    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:03.783682 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:03.783664    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:06.399683 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:06.399641    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:06.795976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:06.795838    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" podUID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" containerName="istio-proxy" containerID="cri-o://67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b" gracePeriod=30
Jul 16 09:36:12.077081 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.077039    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:12.218055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218008    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218058    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218100    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218166    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218195    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218230    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218262    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218391    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218425    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5brz\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz\") pod \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\" (UID: \"d437e189-470f-4e7d-b4a5-6e7f013a4e17\") "
Jul 16 09:36:12.218597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218528    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:12.218778 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218612    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:12.218778 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218650    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:36:12.218878 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218826    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:12.218931 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218787    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.218931 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218901    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.218931 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.218916    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.219103 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.219080    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data" (OuterVolumeSpecName: "istio-data") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:12.220468 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.220433    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:12.220742 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.220678    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:36:12.220837 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.220806    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token" (OuterVolumeSpecName: "istio-token") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:12.220914 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.220889    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz" (OuterVolumeSpecName: "kube-api-access-q5brz") pod "d437e189-470f-4e7d-b4a5-6e7f013a4e17" (UID: "d437e189-470f-4e7d-b4a5-6e7f013a4e17"). InnerVolumeSpecName "kube-api-access-q5brz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:12.320292 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320255    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5brz\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-kube-api-access-q5brz\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.320292 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320287    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.320292 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320296    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.320538 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320303    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.320538 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320314    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d437e189-470f-4e7d-b4a5-6e7f013a4e17-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.320538 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.320323    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d437e189-470f-4e7d-b4a5-6e7f013a4e17-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:12.822715 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.822663    2550 generic.go:356] "Generic (PLEG): container finished" podID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" containerID="67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b" exitCode=0
Jul 16 09:36:12.822926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.822743    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"
Jul 16 09:36:12.822926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.822761    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" event={"ID":"d437e189-470f-4e7d-b4a5-6e7f013a4e17","Type":"ContainerDied","Data":"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"}
Jul 16 09:36:12.822926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.822839    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56" event={"ID":"d437e189-470f-4e7d-b4a5-6e7f013a4e17","Type":"ContainerDied","Data":"c53d22623f70227d3b0e37c8fc4e8ef202687447ad87655fd86dee5e03c85ac2"}
Jul 16 09:36:12.822926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.822873    2550 scope.go:117] "RemoveContainer" containerID="67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"
Jul 16 09:36:12.832162 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.832137    2550 scope.go:117] "RemoveContainer" containerID="67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"
Jul 16 09:36:12.832487 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:36:12.832465    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b\": container with ID starting with 67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b not found: ID does not exist" containerID="67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"
Jul 16 09:36:12.832552 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.832502    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b"} err="failed to get container status \"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b\": rpc error: code = NotFound desc = could not find container \"67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b\": container with ID starting with 67c76188849fd12c7722025abb8bb8d3e2d3fa674208e00edc30d77e6872486b not found: ID does not exist"
Jul 16 09:36:12.847671 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.847632    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:12.851948 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.851917    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-878a849a-gw-openshift-default-697d455fdc-nzl56"]
Jul 16 09:36:12.864464 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:12.864417    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" path="/var/lib/kubelet/pods/d437e189-470f-4e7d-b4a5-6e7f013a4e17/volumes"
Jul 16 09:36:18.299250 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.299213    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:18.299659 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.299515    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" containerName="istio-proxy"
Jul 16 09:36:18.299659 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.299531    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" containerName="istio-proxy"
Jul 16 09:36:18.299659 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.299623    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d437e189-470f-4e7d-b4a5-6e7f013a4e17" containerName="istio-proxy"
Jul 16 09:36:18.302580 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.302555    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.305204 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.305183    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e9c2e924-openshift-default-dockercfg-lndst\""
Jul 16 09:36:18.316504 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.316470    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:18.366347 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366305    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h42v7\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366347 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366350    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366379    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366467    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366517    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366539    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366573    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366593    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.366617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.366609    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.467688 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.467634    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h42v7\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.467688 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.467685    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.467997 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.467885    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.467997 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.467987    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468102 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468045    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468102 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468085    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468199 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468116    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468199 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468148    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468199 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468173    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468408 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468383    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468492 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468467    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468558 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468506    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468614 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468588    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.468676 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.468660    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.470508 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.470484    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.470618 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.470564    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.476852 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.476825    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.477146 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.477123    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h42v7\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7\") pod \"e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") " pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.616277 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.616239    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:18.775761 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.775724    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:18.778879 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:36:18.778843    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a3d247_00f0_4d3f_a6c7_76eef8ec7c48.slice/crio-18ce4ac8e7629a7f6bc1d25ab5ae9feb1b8ad48c78f9d2eeefd6facf92ef82d9 WatchSource:0}: Error finding container 18ce4ac8e7629a7f6bc1d25ab5ae9feb1b8ad48c78f9d2eeefd6facf92ef82d9: Status 404 returned error can't find the container with id 18ce4ac8e7629a7f6bc1d25ab5ae9feb1b8ad48c78f9d2eeefd6facf92ef82d9
Jul 16 09:36:18.781197 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.781157    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:18.781306 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.781233    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:18.781306 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.781265    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:36:18.852895 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.852854    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" event={"ID":"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48","Type":"ContainerStarted","Data":"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"}
Jul 16 09:36:18.853111 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.852909    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" event={"ID":"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48","Type":"ContainerStarted","Data":"18ce4ac8e7629a7f6bc1d25ab5ae9feb1b8ad48c78f9d2eeefd6facf92ef82d9"}
Jul 16 09:36:18.895913 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:18.895779    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" podStartSLOduration=0.895753414 podStartE2EDuration="895.753414ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:36:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:18.894584822 +0000 UTC m=+1876.588512266" watchObservedRunningTime="2026-07-16 09:36:18.895753414 +0000 UTC m=+1876.589680856"
Jul 16 09:36:19.617079 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:19.617033    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:19.622676 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:19.622644    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:19.857671 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:19.857640    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:19.858841 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:19.858815    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:23.962893 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:23.962823    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:23.963808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:23.963454    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" podUID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" containerName="istio-proxy" containerID="cri-o://37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa" gracePeriod=30
Jul 16 09:36:30.625832 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.625804    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:30.687479 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687398    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687479 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687448    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h42v7\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687485    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687505    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687528    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687550    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687581    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687612    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.687808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.687651    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert\") pod \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\" (UID: \"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48\") "
Jul 16 09:36:30.688472 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.688226    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:36:30.688472 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.688275    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:30.688472 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.688406    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:30.688472 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.688433    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:30.688738 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.688531    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:30.689731 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.689686    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:36:30.690178 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.690154    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:36:30.690235 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.690192    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7" (OuterVolumeSpecName: "kube-api-access-h42v7") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "kube-api-access-h42v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:30.690280 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.690270    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" (UID: "f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789001    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789030    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h42v7\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-kube-api-access-h42v7\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789040    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789048    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789056    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789064    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789072    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789080    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.789090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.789088    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:36:30.907095 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.907066    2550 generic.go:356] "Generic (PLEG): container finished" podID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" containerID="37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa" exitCode=0
Jul 16 09:36:30.907262 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.907104    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" event={"ID":"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48","Type":"ContainerDied","Data":"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"}
Jul 16 09:36:30.907262 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.907111    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"
Jul 16 09:36:30.907262 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.907151    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn" event={"ID":"f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48","Type":"ContainerDied","Data":"18ce4ac8e7629a7f6bc1d25ab5ae9feb1b8ad48c78f9d2eeefd6facf92ef82d9"}
Jul 16 09:36:30.907262 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.907176    2550 scope.go:117] "RemoveContainer" containerID="37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"
Jul 16 09:36:30.915535 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.915516    2550 scope.go:117] "RemoveContainer" containerID="37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"
Jul 16 09:36:30.915833 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:36:30.915803    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa\": container with ID starting with 37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa not found: ID does not exist" containerID="37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"
Jul 16 09:36:30.915907 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.915837    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa"} err="failed to get container status \"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa\": rpc error: code = NotFound desc = could not find container \"37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa\": container with ID starting with 37ada92170e20a94d279f4997e1ed59c9f5b68a4069d5cda3d6225f76887ccfa not found: ID does not exist"
Jul 16 09:36:30.922666 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.922644    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:30.926223 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:30.926201    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e9c2e924-openshift-default-54f6789b87-js5sn"]
Jul 16 09:36:32.865135 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:36:32.865105    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" path="/var/lib/kubelet/pods/f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48/volumes"
Jul 16 09:38:05.762055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.761977    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:05.762493 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.762299    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" containerName="istio-proxy"
Jul 16 09:38:05.762493 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.762312    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" containerName="istio-proxy"
Jul 16 09:38:05.762493 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.762377    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3a3d247-00f0-4d3f-a6c7-76eef8ec7c48" containerName="istio-proxy"
Jul 16 09:38:05.765128 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.765113    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.767613 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.767596    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-746d752f-openshift-default-dockercfg-8ql7c\""
Jul 16 09:38:05.786324 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.786297    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:05.874459 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874421    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874634 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874477    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874634 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874561    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874634 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874590    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874815 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874636    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874815 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874670    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874815 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874718    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874815 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874749    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7xd4\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.874815 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.874788    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.975976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.975936    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.975976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.975980    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976009    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976031    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7xd4\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976053    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976110    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976162    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976200    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976223    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976447    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976556    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976581    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.976635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.976607    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.977036 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.977016    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.978619 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.978599    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.978719 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.978683    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.983951 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.983933    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:05.984024 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:05.983978    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7xd4\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4\") pod \"e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") " pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:06.075456 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.075365    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:06.215950 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.215926    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:06.217754 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:38:06.217725    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495315d0_62f1_4a16_bc3a_518c496a6cbb.slice/crio-b3ffcdca0ebc12ebd9223414aee2f4db005f0035857f9a3f0cefa808b10ea90c WatchSource:0}: Error finding container b3ffcdca0ebc12ebd9223414aee2f4db005f0035857f9a3f0cefa808b10ea90c: Status 404 returned error can't find the container with id b3ffcdca0ebc12ebd9223414aee2f4db005f0035857f9a3f0cefa808b10ea90c
Jul 16 09:38:06.219952 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.219922    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:06.220051 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.219999    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:06.220051 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.220040    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:06.297886 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.297849    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerStarted","Data":"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"}
Jul 16 09:38:06.298043 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.297927    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerStarted","Data":"b3ffcdca0ebc12ebd9223414aee2f4db005f0035857f9a3f0cefa808b10ea90c"}
Jul 16 09:38:06.318720 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:06.318631    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podStartSLOduration=1.318609979 podStartE2EDuration="1.318609979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:38:06.317372311 +0000 UTC m=+1984.011299769" watchObservedRunningTime="2026-07-16 09:38:06.318609979 +0000 UTC m=+1984.012537436"
Jul 16 09:38:07.075890 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:07.075858    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:07.080328 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:07.080304    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:07.301959 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:07.301921    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:07.302863 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:07.302839    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:20.352545 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.352512    2550 generic.go:356] "Generic (PLEG): container finished" podID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerID="caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06" exitCode=0
Jul 16 09:38:20.352981 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.352589    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerDied","Data":"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"}
Jul 16 09:38:20.353027 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.352989    2550 scope.go:117] "RemoveContainer" containerID="caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"
Jul 16 09:38:20.353971 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.353947    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:20.354033 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.354006    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:20.354067 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:20.354037    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:38:21.361913 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:21.361866    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerStarted","Data":"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"}
Jul 16 09:38:22.076563 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:22.076533    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:22.077597 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:22.077576    2550 patch_prober.go:28] interesting pod/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 16 09:38:22.077649 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:22.077626    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 16 09:38:22.302452 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:22.302419    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:23.076859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:23.076818    2550 patch_prober.go:28] interesting pod/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 16 09:38:23.077263 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:23.076878    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 16 09:38:24.075982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:24.075949    2550 patch_prober.go:28] interesting pod/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 16 09:38:24.076151 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:24.076005    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 16 09:38:25.076630 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:25.076582    2550 patch_prober.go:28] interesting pod/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Jul 16 09:38:25.077052 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:25.076669    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Jul 16 09:38:26.079900 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:26.079870    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:26.080939 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:26.080918    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:32.517114 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:32.517078    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:32.517542 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:32.517311    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy" containerID="cri-o://990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278" gracePeriod=30
Jul 16 09:38:37.761055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.761028    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:37.767709 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767676    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.767803 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767724    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.767803 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767765    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.767803 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767784    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.767803 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767803    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.768016 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767824    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.768016 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767851    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.768016 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767875    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.768016 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.767900    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7xd4\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4\") pod \"495315d0-62f1-4a16-bc3a-518c496a6cbb\" (UID: \"495315d0-62f1-4a16-bc3a-518c496a6cbb\") "
Jul 16 09:38:37.768222 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.768095    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:38:37.768222 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.768116    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:38:37.768424 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.768391    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:38:37.768562 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.768438    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:38:37.768839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.768818    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data" (OuterVolumeSpecName: "istio-data") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:38:37.769963 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.769938    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:38:37.770088 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.770071    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:38:37.770248 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.770225    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token" (OuterVolumeSpecName: "istio-token") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:38:37.770334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.770296    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4" (OuterVolumeSpecName: "kube-api-access-v7xd4") pod "495315d0-62f1-4a16-bc3a-518c496a6cbb" (UID: "495315d0-62f1-4a16-bc3a-518c496a6cbb"). InnerVolumeSpecName "kube-api-access-v7xd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:38:37.868935 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868905    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.868935 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868936    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868945    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868956    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7xd4\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-kube-api-access-v7xd4\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868966    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868973    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868981    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495315d0-62f1-4a16-bc3a-518c496a6cbb-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868989    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:37.869125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:37.868996    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495315d0-62f1-4a16-bc3a-518c496a6cbb-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:38:38.433259 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.433222    2550 generic.go:356] "Generic (PLEG): container finished" podID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerID="990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278" exitCode=0
Jul 16 09:38:38.433435 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.433285    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"
Jul 16 09:38:38.433435 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.433290    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerDied","Data":"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"}
Jul 16 09:38:38.433435 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.433363    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj" event={"ID":"495315d0-62f1-4a16-bc3a-518c496a6cbb","Type":"ContainerDied","Data":"b3ffcdca0ebc12ebd9223414aee2f4db005f0035857f9a3f0cefa808b10ea90c"}
Jul 16 09:38:38.433435 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.433384    2550 scope.go:117] "RemoveContainer" containerID="990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"
Jul 16 09:38:38.441854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.441834    2550 scope.go:117] "RemoveContainer" containerID="caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"
Jul 16 09:38:38.449021 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.448999    2550 scope.go:117] "RemoveContainer" containerID="990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"
Jul 16 09:38:38.449260 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:38:38.449240    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278\": container with ID starting with 990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278 not found: ID does not exist" containerID="990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"
Jul 16 09:38:38.449338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.449273    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278"} err="failed to get container status \"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278\": rpc error: code = NotFound desc = could not find container \"990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278\": container with ID starting with 990e6bedabb9676aed3865ed0b9f480ac31c2151031c6f9b0c582dbfb9f0b278 not found: ID does not exist"
Jul 16 09:38:38.449338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.449298    2550 scope.go:117] "RemoveContainer" containerID="caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"
Jul 16 09:38:38.449560 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:38:38.449542    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06\": container with ID starting with caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06 not found: ID does not exist" containerID="caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"
Jul 16 09:38:38.449598 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.449567    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06"} err="failed to get container status \"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06\": rpc error: code = NotFound desc = could not find container \"caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06\": container with ID starting with caeb29c5d7a213638c42a8a1f155567e67c86697e502227d2795c08a2133ec06 not found: ID does not exist"
Jul 16 09:38:38.456829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.456809    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:38.458729 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.458709    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-746d752f-openshift-default-ffb9b94bc-zf5mj"]
Jul 16 09:38:38.864048 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:38:38.864017    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" path="/var/lib/kubelet/pods/495315d0-62f1-4a16-bc3a-518c496a6cbb/volumes"
Jul 16 09:39:45.688283 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688245    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688540    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688552    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688563    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688569    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688618    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.688826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.688626    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="495315d0-62f1-4a16-bc3a-518c496a6cbb" containerName="istio-proxy"
Jul 16 09:39:45.691549 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.691527    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.693839 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.693819    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-58462d-openshift-default-dockercfg-p86pw\""
Jul 16 09:39:45.703326 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.703297    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:39:45.716946 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.716923    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717061 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.716956    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4vz\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717061 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717000    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717162 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717079    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717162 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717129    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717162 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717153    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717302 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717174    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717302 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717197    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.717397 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.717327    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818177 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818150    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818218    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818251    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818278    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4vz\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818303    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818334 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818331    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818362    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818395    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818425    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818767 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818648    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.818941 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818921    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.819007 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818939    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.819007 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.818976    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.819081 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.819008    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.820746 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.820729    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.820982 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.820965    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.830768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.830741    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:45.831010 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:45.830987    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4vz\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz\") pod \"e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") " pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:46.002744 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.002667    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:46.139133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.139106    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:39:46.141721 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:39:46.141664    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab13cd5_a5b8_46e4_8742_a93b264d4cfa.slice/crio-8faa61da15f3f3efcb5f5e1ed46e1bc2ecc38bd0059b070ce29186936aaee099 WatchSource:0}: Error finding container 8faa61da15f3f3efcb5f5e1ed46e1bc2ecc38bd0059b070ce29186936aaee099: Status 404 returned error can't find the container with id 8faa61da15f3f3efcb5f5e1ed46e1bc2ecc38bd0059b070ce29186936aaee099
Jul 16 09:39:46.144169 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.144138    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:46.144237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.144209    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:46.144273 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.144240    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:46.713258 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.713215    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerStarted","Data":"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"}
Jul 16 09:39:46.713720 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.713281    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerStarted","Data":"8faa61da15f3f3efcb5f5e1ed46e1bc2ecc38bd0059b070ce29186936aaee099"}
Jul 16 09:39:46.735233 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:46.735185    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podStartSLOduration=1.735168511 podStartE2EDuration="1.735168511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:39:46.732907355 +0000 UTC m=+2084.426834796" watchObservedRunningTime="2026-07-16 09:39:46.735168511 +0000 UTC m=+2084.429095954"
Jul 16 09:39:47.003793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:47.003695    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:47.008379 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:47.008357    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:47.718573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:47.718545    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:47.719381 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:47.719364    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:39:53.743669 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.743633    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:39:53.747487 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.747465    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.749731 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.749692    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e84a9d-openshift-default-dockercfg-7qljh\""
Jul 16 09:39:53.759406 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.759382    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:39:53.781242 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781207    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781242 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781247    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781393 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781276    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781393 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781337    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781495 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781455    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6s5r\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781555 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781501    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781555 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781529    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781636 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781553    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.781636 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.781603    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882625 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882588    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882625 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882627    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882684    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6s5r\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882736    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882760    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882783    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882835    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.882883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882869    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.882902    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.883054    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.883077    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883289 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.883250    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883322 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.883311    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.883506 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.883488    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.885162 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.885137    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.885289 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.885270    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.890808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.890784    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:53.890904 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:53.890885    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6s5r\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r\") pod \"e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") " pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:54.059217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.059158    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:54.186943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.186917    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:39:54.189053 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:39:54.189014    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ed1099_c083_422e_b331_66b8f0a3e13a.slice/crio-552f5a89c329df3a31db7e1e182e9c09eaeed576b1c9a1fe66a1d731a7ec9095 WatchSource:0}: Error finding container 552f5a89c329df3a31db7e1e182e9c09eaeed576b1c9a1fe66a1d731a7ec9095: Status 404 returned error can't find the container with id 552f5a89c329df3a31db7e1e182e9c09eaeed576b1c9a1fe66a1d731a7ec9095
Jul 16 09:39:54.191200 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.191166    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:54.191297 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.191230    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:54.191297 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.191261    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:39:54.750389 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.750353    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerStarted","Data":"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"}
Jul 16 09:39:54.750859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.750399    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerStarted","Data":"552f5a89c329df3a31db7e1e182e9c09eaeed576b1c9a1fe66a1d731a7ec9095"}
Jul 16 09:39:54.770365 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:54.770318    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podStartSLOduration=1.770298902 podStartE2EDuration="1.770298902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:39:54.769562475 +0000 UTC m=+2092.463489918" watchObservedRunningTime="2026-07-16 09:39:54.770298902 +0000 UTC m=+2092.464226345"
Jul 16 09:39:55.060099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:55.060022    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:55.064918 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:55.064890    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:55.754772 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:55.754746    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:39:55.755756 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:39:55.755734    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:40:03.760859 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:03.760822    2550 patch_prober.go:28] interesting pod/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 09:40:03.761238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:03.760880    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 09:40:04.799100 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.799067    2550 generic.go:356] "Generic (PLEG): container finished" podID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerID="398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff" exitCode=0
Jul 16 09:40:04.799530 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.799108    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerDied","Data":"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"}
Jul 16 09:40:04.799530 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.799447    2550 scope.go:117] "RemoveContainer" containerID="398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"
Jul 16 09:40:04.800401 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.800372    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:04.800507 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.800441    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:04.800507 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:04.800472    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:05.805007 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:05.804966    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerStarted","Data":"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"}
Jul 16 09:40:06.003408 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:06.003368    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:40:06.003613 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:06.003465    2550 patch_prober.go:28] interesting pod/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 09:40:06.003613 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:06.003502    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 09:40:07.003772 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:07.003733    2550 patch_prober.go:28] interesting pod/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 09:40:07.004154 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:07.003804    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 09:40:08.003098 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:08.003057    2550 patch_prober.go:28] interesting pod/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 09:40:08.003299 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:08.003123    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 09:40:09.003869 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:09.003830    2550 patch_prober.go:28] interesting pod/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 16 09:40:09.004240 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:09.003890    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 16 09:40:10.006644 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:10.006614    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:40:10.007120 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:10.007029    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:40:10.007842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:10.007820    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:40:11.304542 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.303316    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:34334->10.133.0.30:15021: read: connection reset by peer" start-of-body=
Jul 16 09:40:11.304542 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.303386    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": read tcp 10.133.0.2:34334->10.133.0.30:15021: read: connection reset by peer"
Jul 16 09:40:11.834647 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.834617    2550 generic.go:356] "Generic (PLEG): container finished" podID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerID="10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93" exitCode=0
Jul 16 09:40:11.834917 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.834711    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerDied","Data":"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"}
Jul 16 09:40:11.835227 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.835212    2550 scope.go:117] "RemoveContainer" containerID="10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"
Jul 16 09:40:11.836139 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.836114    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:11.836195 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.836177    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:11.836232 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:11.836211    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 09:40:12.841894 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:12.841862    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerStarted","Data":"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"}
Jul 16 09:40:13.060090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:13.060055    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:40:13.060482 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:13.060386    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 16 09:40:13.060657 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:13.060633    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 16 09:40:14.059794 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:14.059761    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 16 09:40:14.060355 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:14.060323    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 16 09:40:15.060071 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:15.060034    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 16 09:40:15.060641 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:15.060609    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 16 09:40:16.060232 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:16.060193    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 16 09:40:16.060828 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:16.060797    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 16 09:40:17.063275 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:17.063243    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:40:17.063855 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:17.063624    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:40:17.064236 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:17.064222    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:40:23.258382 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.258351    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:40:23.261668 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.261651    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.264009 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.263989    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e84a9d\"/\"default-dockercfg-4gwfn\""
Jul 16 09:40:23.264115 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.263989    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e84a9d\"/\"kube-root-ca.crt\""
Jul 16 09:40:23.264823 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.264804    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e84a9d\"/\"openshift-service-ca.crt\""
Jul 16 09:40:23.264929 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.264887    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e84a9d\"/\"test-model-e84a9d-kserve-self-signed-certs\""
Jul 16 09:40:23.270254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.270232    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:40:23.449316 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449282    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltkr\" (UniqueName: \"kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.449492 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449322    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.449492 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449357    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.449492 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449442    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.449492 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449475    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.449649 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.449499    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550485    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550539    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550650    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550687    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550742    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tltkr\" (UniqueName: \"kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550784    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.550969 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.550957    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.551023 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.551001    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.551152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.551133    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.552992 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.552975    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.553185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.553167    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.559356 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.559331    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltkr\" (UniqueName: \"kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr\") pod \"test-model-e84a9d-kserve-6b57d94455-6bx22\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") " pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.571307 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.571291    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:23.704243 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.704215    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:40:23.705732 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:40:23.705691    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaa83f41_9d2e_4e8d_aa6a_51608635d028.slice/crio-823610fd6b7c3e25a3152d65eb9f3a70fc83b639290e7a7668ef4300bb8be82b WatchSource:0}: Error finding container 823610fd6b7c3e25a3152d65eb9f3a70fc83b639290e7a7668ef4300bb8be82b: Status 404 returned error can't find the container with id 823610fd6b7c3e25a3152d65eb9f3a70fc83b639290e7a7668ef4300bb8be82b
Jul 16 09:40:23.892256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.892222    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" event={"ID":"faa83f41-9d2e-4e8d-aa6a-51608635d028","Type":"ContainerStarted","Data":"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"}
Jul 16 09:40:23.892426 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.892266    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" event={"ID":"faa83f41-9d2e-4e8d-aa6a-51608635d028","Type":"ContainerStarted","Data":"823610fd6b7c3e25a3152d65eb9f3a70fc83b639290e7a7668ef4300bb8be82b"}
Jul 16 09:40:23.908556 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:23.908498    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" podStartSLOduration=0.908478133 podStartE2EDuration="908.478133ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:40:23.907977827 +0000 UTC m=+2121.601905290" watchObservedRunningTime="2026-07-16 09:40:23.908478133 +0000 UTC m=+2121.602405578"
Jul 16 09:40:33.572463 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:33.572409    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:33.572903 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:33.572510    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:33.589511 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:33.589484    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:33.945463 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:33.945431    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:40:55.502612 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:40:55.502519    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:41:10.522810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.522766    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" podUID="faa83f41-9d2e-4e8d-aa6a-51608635d028" containerName="main" containerID="cri-o://1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648" gracePeriod=45
Jul 16 09:41:10.781076 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.781015    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:41:10.957998 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.957962    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958021    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958049    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958077    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958092    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958172 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958145    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tltkr\" (UniqueName: \"kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr\") pod \"faa83f41-9d2e-4e8d-aa6a-51608635d028\" (UID: \"faa83f41-9d2e-4e8d-aa6a-51608635d028\") "
Jul 16 09:41:10.958433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958282    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache" (OuterVolumeSpecName: "model-cache") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:10.958433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958367    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home" (OuterVolumeSpecName: "home") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:10.958433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.958397    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:10.960429 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.960392    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:41:10.960544 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.960421    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr" (OuterVolumeSpecName: "kube-api-access-tltkr") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "kube-api-access-tltkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:10.960544 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:10.960407    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm" (OuterVolumeSpecName: "dshm") pod "faa83f41-9d2e-4e8d-aa6a-51608635d028" (UID: "faa83f41-9d2e-4e8d-aa6a-51608635d028"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059553    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-model-cache\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059581    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-home\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059589    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-tmp-dir\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059597    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faa83f41-9d2e-4e8d-aa6a-51608635d028-tls-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059604    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faa83f41-9d2e-4e8d-aa6a-51608635d028-dshm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.059635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.059613    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tltkr\" (UniqueName: \"kubernetes.io/projected/faa83f41-9d2e-4e8d-aa6a-51608635d028-kube-api-access-tltkr\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:11.087211 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.087175    2550 generic.go:356] "Generic (PLEG): container finished" podID="faa83f41-9d2e-4e8d-aa6a-51608635d028" containerID="1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648" exitCode=0
Jul 16 09:41:11.087346 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.087223    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"
Jul 16 09:41:11.087346 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.087255    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" event={"ID":"faa83f41-9d2e-4e8d-aa6a-51608635d028","Type":"ContainerDied","Data":"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"}
Jul 16 09:41:11.087346 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.087297    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22" event={"ID":"faa83f41-9d2e-4e8d-aa6a-51608635d028","Type":"ContainerDied","Data":"823610fd6b7c3e25a3152d65eb9f3a70fc83b639290e7a7668ef4300bb8be82b"}
Jul 16 09:41:11.087346 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.087314    2550 scope.go:117] "RemoveContainer" containerID="1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"
Jul 16 09:41:11.096288 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.096269    2550 scope.go:117] "RemoveContainer" containerID="1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"
Jul 16 09:41:11.096531 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:41:11.096511    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648\": container with ID starting with 1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648 not found: ID does not exist" containerID="1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"
Jul 16 09:41:11.096584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.096540    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648"} err="failed to get container status \"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648\": rpc error: code = NotFound desc = could not find container \"1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648\": container with ID starting with 1f79e93f884832aec2c32767ced5f895552c1818dbfcce7e773c5e4a02406648 not found: ID does not exist"
Jul 16 09:41:11.107307 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.107284    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:41:11.109190 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:11.109169    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e84a9d/test-model-e84a9d-kserve-6b57d94455-6bx22"]
Jul 16 09:41:12.863923 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:12.863896    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faa83f41-9d2e-4e8d-aa6a-51608635d028" path="/var/lib/kubelet/pods/faa83f41-9d2e-4e8d-aa6a-51608635d028/volumes"
Jul 16 09:41:44.364148 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:44.364114    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:41:44.364748 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:44.364288    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy" containerID="cri-o://db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952" gracePeriod=30
Jul 16 09:41:49.609887 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.609864    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:41:49.665584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665523    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665565    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665583    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665603    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665628    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665644    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665668    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665693    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.665820 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665775    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b4vz\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz\") pod \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\" (UID: \"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa\") "
Jul 16 09:41:49.666099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665867    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:49.666099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.665936    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:49.666099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.666008    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:49.666099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.666026    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.666099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.666043    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.666353 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.666289    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:41:49.666742 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.666689    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:49.667809 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.667787    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:41:49.668014 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.667994    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:49.668073 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.668005    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:41:49.668293 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.668279    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz" (OuterVolumeSpecName: "kube-api-access-9b4vz") pod "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" (UID: "0ab13cd5-a5b8-46e4-8742-a93b264d4cfa"). InnerVolumeSpecName "kube-api-access-9b4vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:41:49.766993 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.766972    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b4vz\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-kube-api-access-9b4vz\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.766993 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.766993    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.767170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.767002    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.767170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.767011    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.767170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.767019    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.767170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.767027    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:49.767170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:49.767033    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:41:50.250997 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.250965    2550 generic.go:356] "Generic (PLEG): container finished" podID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerID="db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952" exitCode=0
Jul 16 09:41:50.251113 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.251013    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"
Jul 16 09:41:50.251113 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.251051    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerDied","Data":"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"}
Jul 16 09:41:50.251186 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.251116    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj" event={"ID":"0ab13cd5-a5b8-46e4-8742-a93b264d4cfa","Type":"ContainerDied","Data":"8faa61da15f3f3efcb5f5e1ed46e1bc2ecc38bd0059b070ce29186936aaee099"}
Jul 16 09:41:50.251186 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.251142    2550 scope.go:117] "RemoveContainer" containerID="db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"
Jul 16 09:41:50.260892 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.260872    2550 scope.go:117] "RemoveContainer" containerID="398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"
Jul 16 09:41:50.268780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.268761    2550 scope.go:117] "RemoveContainer" containerID="db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"
Jul 16 09:41:50.269072 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:41:50.269048    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952\": container with ID starting with db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952 not found: ID does not exist" containerID="db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"
Jul 16 09:41:50.269170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.269077    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952"} err="failed to get container status \"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952\": rpc error: code = NotFound desc = could not find container \"db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952\": container with ID starting with db81f48d70b577aa874ab51082c0099d9fa1895caf690c2281c3677c0015e952 not found: ID does not exist"
Jul 16 09:41:50.269170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.269096    2550 scope.go:117] "RemoveContainer" containerID="398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"
Jul 16 09:41:50.269410 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:41:50.269387    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff\": container with ID starting with 398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff not found: ID does not exist" containerID="398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"
Jul 16 09:41:50.269457 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.269418    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff"} err="failed to get container status \"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff\": rpc error: code = NotFound desc = could not find container \"398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff\": container with ID starting with 398c3bbf3aafad31d1c929cf83f85777899952ea46da2bf330ed738195313eff not found: ID does not exist"
Jul 16 09:41:50.274365 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.274339    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:41:50.279156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.279131    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-58462d-openshift-default-f94cd7f99-xplpj"]
Jul 16 09:41:50.864459 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:50.864422    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" path="/var/lib/kubelet/pods/0ab13cd5-a5b8-46e4-8742-a93b264d4cfa/volumes"
Jul 16 09:41:57.233711 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:57.233664    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:41:57.234092 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:41:57.233889    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" containerID="cri-o://3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e" gracePeriod=30
Jul 16 09:42:02.066128 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.066089    2550 patch_prober.go:28] interesting pod/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 09:42:02.066482 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.066150    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 09:42:02.477924 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.477901    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:42:02.563194 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563164    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563218    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6s5r\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563241    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563261    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563338 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563287    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563532 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563381    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563532 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563424    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563532 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563424    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:02.563532 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563457    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563737 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563531    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:02.563737 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563550    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert\") pod \"38ed1099-c083-422e-b331-66b8f0a3e13a\" (UID: \"38ed1099-c083-422e-b331-66b8f0a3e13a\") "
Jul 16 09:42:02.563737 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563561    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:02.563853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563821    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-credential-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.563853 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563841    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-socket\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.563946 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.563854    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-workload-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.564130 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.564111    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:42:02.564495 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.564466    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data" (OuterVolumeSpecName: "istio-data") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:02.565528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.565505    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:42:02.565611 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.565550    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 09:42:02.565803 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.565778    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token" (OuterVolumeSpecName: "istio-token") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:02.565850 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.565787    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r" (OuterVolumeSpecName: "kube-api-access-h6s5r") pod "38ed1099-c083-422e-b331-66b8f0a3e13a" (UID: "38ed1099-c083-422e-b331-66b8f0a3e13a"). InnerVolumeSpecName "kube-api-access-h6s5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:02.665059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665034    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6s5r\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-kube-api-access-h6s5r\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.665059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665058    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-envoy\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.665182 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665068    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-token\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.665182 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665076    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-data\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.665182 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665083    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38ed1099-c083-422e-b331-66b8f0a3e13a-istio-podinfo\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:02.665182 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:02.665090    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38ed1099-c083-422e-b331-66b8f0a3e13a-istiod-ca-cert\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:03.304841 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.304754    2550 generic.go:356] "Generic (PLEG): container finished" podID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerID="3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e" exitCode=0
Jul 16 09:42:03.304841 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.304796    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"
Jul 16 09:42:03.304841 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.304813    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerDied","Data":"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"}
Jul 16 09:42:03.305387 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.304867    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r" event={"ID":"38ed1099-c083-422e-b331-66b8f0a3e13a","Type":"ContainerDied","Data":"552f5a89c329df3a31db7e1e182e9c09eaeed576b1c9a1fe66a1d731a7ec9095"}
Jul 16 09:42:03.305387 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.304896    2550 scope.go:117] "RemoveContainer" containerID="3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"
Jul 16 09:42:03.312737 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.312720    2550 scope.go:117] "RemoveContainer" containerID="10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"
Jul 16 09:42:03.319758 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.319741    2550 scope.go:117] "RemoveContainer" containerID="3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"
Jul 16 09:42:03.319995 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:03.319968    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e\": container with ID starting with 3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e not found: ID does not exist" containerID="3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"
Jul 16 09:42:03.320059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.320006    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e"} err="failed to get container status \"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e\": rpc error: code = NotFound desc = could not find container \"3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e\": container with ID starting with 3f2933dc60ba62e29183a584502e4086024a789db631f4da9a0a245de5dbd48e not found: ID does not exist"
Jul 16 09:42:03.320059 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.320027    2550 scope.go:117] "RemoveContainer" containerID="10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"
Jul 16 09:42:03.320258 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:03.320241    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93\": container with ID starting with 10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93 not found: ID does not exist" containerID="10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"
Jul 16 09:42:03.320307 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.320264    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93"} err="failed to get container status \"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93\": rpc error: code = NotFound desc = could not find container \"10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93\": container with ID starting with 10d04879254b28780087a641d018c9f1949a125fd1520d807718870461fd9c93 not found: ID does not exist"
Jul 16 09:42:03.348415 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.348391    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:42:03.371122 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:03.371097    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e84a9d-openshift-default-56c877b9c-hph7r"]
Jul 16 09:42:04.863217 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:04.863184    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" path="/var/lib/kubelet/pods/38ed1099-c083-422e-b331-66b8f0a3e13a/volumes"
Jul 16 09:42:11.050351 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050312    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050681    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050715    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050739    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050747    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050756    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faa83f41-9d2e-4e8d-aa6a-51608635d028" containerName="main"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050764    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="faa83f41-9d2e-4e8d-aa6a-51608635d028" containerName="main"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050790    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.050814 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050797    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.051185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050873    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.051185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050885    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="faa83f41-9d2e-4e8d-aa6a-51608635d028" containerName="main"
Jul 16 09:42:11.051185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050895    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:11.051185 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.050904    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab13cd5-a5b8-46e4-8742-a93b264d4cfa" containerName="istio-proxy"
Jul 16 09:42:11.053738 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.053717    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.056590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.056567    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:42:11.056725 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.056610    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d109ac-serving-cert\""
Jul 16 09:42:11.056725 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.056621    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:42:11.057639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.057619    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:42:11.066098 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.066075    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:11.130958 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.130929    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bksm\" (UniqueName: \"kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.131079 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.130975    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.131079 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.131061    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.232034 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.232001    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.232223 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.232049    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.232223 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.232117    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bksm\" (UniqueName: \"kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.232436 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:11.232235    2550 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-serving-cert: secret "maas-api-e2e-api-b-d109ac-serving-cert" not found
Jul 16 09:42:11.232436 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:11.232315    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls podName:12701972-56cc-42a6-8786-04068604397c nodeName:}" failed. No retries permitted until 2026-07-16 09:42:11.732291175 +0000 UTC m=+2229.426218611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls") pod "maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" (UID: "12701972-56cc-42a6-8786-04068604397c") : secret "maas-api-e2e-api-b-d109ac-serving-cert" not found
Jul 16 09:42:11.232793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.232773    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.252655 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.252626    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bksm\" (UniqueName: \"kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.735354 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.735319    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.737722 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.737680    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") pod \"maas-api-e2e-api-b-d109ac-786c7568fd-q79xf\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:11.963413 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:11.963375    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:12.089455 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:12.089425    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:12.093137 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:42:12.093104    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12701972_56cc_42a6_8786_04068604397c.slice/crio-8271324747e09b10470d7daf2f890baca5d7497674304fb672e01d140299c04b WatchSource:0}: Error finding container 8271324747e09b10470d7daf2f890baca5d7497674304fb672e01d140299c04b: Status 404 returned error can't find the container with id 8271324747e09b10470d7daf2f890baca5d7497674304fb672e01d140299c04b
Jul 16 09:42:12.094448 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:12.094430    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:42:12.345027 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:12.344948    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" event={"ID":"12701972-56cc-42a6-8786-04068604397c","Type":"ContainerStarted","Data":"8271324747e09b10470d7daf2f890baca5d7497674304fb672e01d140299c04b"}
Jul 16 09:42:14.355323 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:14.355295    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" event={"ID":"12701972-56cc-42a6-8786-04068604397c","Type":"ContainerStarted","Data":"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"}
Jul 16 09:42:14.355636 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:14.355406    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:14.371497 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:14.371450    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" podStartSLOduration=1.173202354 podStartE2EDuration="3.371434017s" totalImagesPullingTime="2.198231663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:14.36968105 +0000 UTC m=+2232.063608490" watchObservedRunningTime="2026-07-16 09:42:14.371434017 +0000 UTC m=+2232.065361458"
Jul 16 09:42:20.364780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:20.364754    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:43.039137 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.039042    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:43.039795 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.039331    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" podUID="12701972-56cc-42a6-8786-04068604397c" containerName="maas-api" containerID="cri-o://e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a" gracePeriod=30
Jul 16 09:42:43.278168 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.278143    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:43.403411 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.403382    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") pod \"12701972-56cc-42a6-8786-04068604397c\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") "
Jul 16 09:42:43.403617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.403428    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca\") pod \"12701972-56cc-42a6-8786-04068604397c\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") "
Jul 16 09:42:43.403617 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.403476    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bksm\" (UniqueName: \"kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm\") pod \"12701972-56cc-42a6-8786-04068604397c\" (UID: \"12701972-56cc-42a6-8786-04068604397c\") "
Jul 16 09:42:43.403883 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.403848    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12701972-56cc-42a6-8786-04068604397c" (UID: "12701972-56cc-42a6-8786-04068604397c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:42:43.405692 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.405670    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm" (OuterVolumeSpecName: "kube-api-access-9bksm") pod "12701972-56cc-42a6-8786-04068604397c" (UID: "12701972-56cc-42a6-8786-04068604397c"). InnerVolumeSpecName "kube-api-access-9bksm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:42:43.405778 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.405731    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12701972-56cc-42a6-8786-04068604397c" (UID: "12701972-56cc-42a6-8786-04068604397c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:42:43.471066 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.471031    2550 generic.go:356] "Generic (PLEG): container finished" podID="12701972-56cc-42a6-8786-04068604397c" containerID="e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a" exitCode=0
Jul 16 09:42:43.471207 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.471076    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"
Jul 16 09:42:43.471207 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.471109    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" event={"ID":"12701972-56cc-42a6-8786-04068604397c","Type":"ContainerDied","Data":"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"}
Jul 16 09:42:43.471207 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.471157    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf" event={"ID":"12701972-56cc-42a6-8786-04068604397c","Type":"ContainerDied","Data":"8271324747e09b10470d7daf2f890baca5d7497674304fb672e01d140299c04b"}
Jul 16 09:42:43.471207 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.471179    2550 scope.go:117] "RemoveContainer" containerID="e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"
Jul 16 09:42:43.479273 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.479257    2550 scope.go:117] "RemoveContainer" containerID="e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"
Jul 16 09:42:43.479513 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:43.479495    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a\": container with ID starting with e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a not found: ID does not exist" containerID="e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"
Jul 16 09:42:43.479577 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.479519    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a"} err="failed to get container status \"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a\": rpc error: code = NotFound desc = could not find container \"e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a\": container with ID starting with e1b76c3e2ef340ee826ed56ec732a90c94b458b0a5b6474d659ba7e59490643a not found: ID does not exist"
Jul 16 09:42:43.490882 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.490856    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:43.497871 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.497851    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d109ac-786c7568fd-q79xf"]
Jul 16 09:42:43.504238 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.504224    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bksm\" (UniqueName: \"kubernetes.io/projected/12701972-56cc-42a6-8786-04068604397c-kube-api-access-9bksm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:43.504303 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.504240    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12701972-56cc-42a6-8786-04068604397c-maas-api-tls\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:43.504303 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:43.504252    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12701972-56cc-42a6-8786-04068604397c-openshift-service-ca\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:42:44.863405 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:44.863374    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12701972-56cc-42a6-8786-04068604397c" path="/var/lib/kubelet/pods/12701972-56cc-42a6-8786-04068604397c/volumes"
Jul 16 09:42:52.362368 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362335    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362742    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12701972-56cc-42a6-8786-04068604397c" containerName="maas-api"
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362759    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="12701972-56cc-42a6-8786-04068604397c" containerName="maas-api"
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362791    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362799    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362878    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="12701972-56cc-42a6-8786-04068604397c" containerName="maas-api"
Jul 16 09:42:52.362943 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.362889    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ed1099-c083-422e-b331-66b8f0a3e13a" containerName="istio-proxy"
Jul 16 09:42:52.369373 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.369350    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.371672 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.371646    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0b4ce8-serving-cert\""
Jul 16 09:42:52.371886 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.371866    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 09:42:52.371953 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.371880    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 09:42:52.372540 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.372527    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp4zf\""
Jul 16 09:42:52.380829 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.380801    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:42:52.484170 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.484129    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.484373 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.484240    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.484373 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.484269    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbn7\" (UniqueName: \"kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.585723 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.585648    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.585723 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.585722    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbn7\" (UniqueName: \"kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.585990 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.585807    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.585990 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:52.585919    2550 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-serving-cert: secret "maas-api-e2e-shared-a-0b4ce8-serving-cert" not found
Jul 16 09:42:52.585990 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:42:52.585987    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls podName:02f099fa-d79d-4547-bbfd-60686ec216a3 nodeName:}" failed. No retries permitted until 2026-07-16 09:42:53.085967078 +0000 UTC m=+2270.779894498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls") pod "maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" (UID: "02f099fa-d79d-4547-bbfd-60686ec216a3") : secret "maas-api-e2e-shared-a-0b4ce8-serving-cert" not found
Jul 16 09:42:52.586395 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.586368    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:52.598752 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:52.598725    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbn7\" (UniqueName: \"kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:53.089898 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:53.089853    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:53.092277 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:53.092256    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:53.281804 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:53.281773    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:53.414195 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:53.414170    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:42:53.416138 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:42:53.416110    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f099fa_d79d_4547_bbfd_60686ec216a3.slice/crio-9ea9483bb2dd6a8c570d18316c64ed5e1f3b7f8427f7517da3c66a5bd07f826b WatchSource:0}: Error finding container 9ea9483bb2dd6a8c570d18316c64ed5e1f3b7f8427f7517da3c66a5bd07f826b: Status 404 returned error can't find the container with id 9ea9483bb2dd6a8c570d18316c64ed5e1f3b7f8427f7517da3c66a5bd07f826b
Jul 16 09:42:53.511362 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:53.511326    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" event={"ID":"02f099fa-d79d-4547-bbfd-60686ec216a3","Type":"ContainerStarted","Data":"9ea9483bb2dd6a8c570d18316c64ed5e1f3b7f8427f7517da3c66a5bd07f826b"}
Jul 16 09:42:54.516830 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:54.516797    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" event={"ID":"02f099fa-d79d-4547-bbfd-60686ec216a3","Type":"ContainerStarted","Data":"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"}
Jul 16 09:42:54.517199 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:54.516896    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:42:54.535064 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:42:54.535012    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" podStartSLOduration=2.219845675 podStartE2EDuration="2.534996356s" totalImagesPullingTime="315.150681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:42:54.533951453 +0000 UTC m=+2272.227878894" watchObservedRunningTime="2026-07-16 09:42:54.534996356 +0000 UTC m=+2272.228923796"
Jul 16 09:43:00.373811 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.373765    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:43:00.377301 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.377282    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.379903 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.379883    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-8577c1-serving-cert\""
Jul 16 09:43:00.387056 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.387032    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:43:00.448556 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.448507    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.448757 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.448580    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84trb\" (UniqueName: \"kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.448757 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.448614    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.526427 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.526402    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:43:00.549254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.549218    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84trb\" (UniqueName: \"kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.549254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.549259    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.549536 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.549347    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.549536 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:43:00.549482    2550 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-serving-cert: secret "maas-api-e2e-shared-b-8577c1-serving-cert" not found
Jul 16 09:43:00.549637 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:43:00.549540    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls podName:8445c00b-c8ac-48ba-b882-938da928e0a4 nodeName:}" failed. No retries permitted until 2026-07-16 09:43:01.049519881 +0000 UTC m=+2278.743447302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls") pod "maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" (UID: "8445c00b-c8ac-48ba-b882-938da928e0a4") : secret "maas-api-e2e-shared-b-8577c1-serving-cert" not found
Jul 16 09:43:00.550004 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.549980    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:00.563143 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:00.563116    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84trb\" (UniqueName: \"kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:01.052973 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:01.052930    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:01.055385 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:01.055353    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") pod \"maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:01.288099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:01.288060    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:01.420495 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:01.420470    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:43:01.422522 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:43:01.422497    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8445c00b_c8ac_48ba_b882_938da928e0a4.slice/crio-7c73e7cfcdfeb8ba3da947b918205c539ce505a2b1c5b5ba198e22d3ac19b7ee WatchSource:0}: Error finding container 7c73e7cfcdfeb8ba3da947b918205c539ce505a2b1c5b5ba198e22d3ac19b7ee: Status 404 returned error can't find the container with id 7c73e7cfcdfeb8ba3da947b918205c539ce505a2b1c5b5ba198e22d3ac19b7ee
Jul 16 09:43:01.545123 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:01.545081    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" event={"ID":"8445c00b-c8ac-48ba-b882-938da928e0a4","Type":"ContainerStarted","Data":"7c73e7cfcdfeb8ba3da947b918205c539ce505a2b1c5b5ba198e22d3ac19b7ee"}
Jul 16 09:43:02.550738 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:02.550679    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" event={"ID":"8445c00b-c8ac-48ba-b882-938da928e0a4","Type":"ContainerStarted","Data":"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"}
Jul 16 09:43:02.551189 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:02.550755    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:02.567746 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:02.567673    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" podStartSLOduration=2.121907115 podStartE2EDuration="2.567645373s" totalImagesPullingTime="445.738258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:43:02.566362025 +0000 UTC m=+2280.260289489" watchObservedRunningTime="2026-07-16 09:43:02.567645373 +0000 UTC m=+2280.261572814"
Jul 16 09:43:08.560929 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:08.560898    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:43:23.874744 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.874684    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:43:23.877637 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.877620    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.880832 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.880808    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"default-dockercfg-7pvs7\""
Jul 16 09:43:23.880972 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.880853    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"auth-test-model-0b4ce8-kserve-self-signed-certs\""
Jul 16 09:43:23.880972 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.880814    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"kube-root-ca.crt\""
Jul 16 09:43:23.880972 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.880900    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"openshift-service-ca.crt\""
Jul 16 09:43:23.888208 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.888185    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:43:23.941594 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941567    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.941594 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941596    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.941817 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941637    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.941817 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941685    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.941817 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941738    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:23.941817 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:23.941757    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x42m\" (UniqueName: \"kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.042818 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042784    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.042818 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042816    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042860    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042878    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042894    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043049 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.042911    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x42m\" (UniqueName: \"kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043267 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.043243    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.043272    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.043335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.043316    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.045150 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.045127    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.045376 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.045357    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.053799 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.053779    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x42m\" (UniqueName: \"kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m\") pod \"auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") " pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.187055 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.186955    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:24.313196 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.313165    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:43:24.315894 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:43:24.315869    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod903993f6_0ab2_4033_bbb5_e4283d43ce0e.slice/crio-385d188b78db734f7b9383a9a8f723df6b220c14c3d8de376b19e1a888a782b8 WatchSource:0}: Error finding container 385d188b78db734f7b9383a9a8f723df6b220c14c3d8de376b19e1a888a782b8: Status 404 returned error can't find the container with id 385d188b78db734f7b9383a9a8f723df6b220c14c3d8de376b19e1a888a782b8
Jul 16 09:43:24.640092 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.640060    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" event={"ID":"903993f6-0ab2-4033-bbb5-e4283d43ce0e","Type":"ContainerStarted","Data":"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"}
Jul 16 09:43:24.640255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.640100    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" event={"ID":"903993f6-0ab2-4033-bbb5-e4283d43ce0e","Type":"ContainerStarted","Data":"385d188b78db734f7b9383a9a8f723df6b220c14c3d8de376b19e1a888a782b8"}
Jul 16 09:43:24.660879 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:24.660831    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" podStartSLOduration=1.660816449 podStartE2EDuration="1.660816449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:43:24.659549859 +0000 UTC m=+2302.353477323" watchObservedRunningTime="2026-07-16 09:43:24.660816449 +0000 UTC m=+2302.354743890"
Jul 16 09:43:34.187239 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:34.187204    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:34.187753 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:34.187269    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:34.199676 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:34.199652    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:43:34.690601 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:43:34.690574    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:46:07.894157 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:07.894124    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:46:15.378218 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.378185    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:46:15.381653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.381632    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.383804 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.383779    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"sub-test-model-0b4ce8-kserve-self-signed-certs\""
Jul 16 09:46:15.391534 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.391512    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:46:15.523653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523622    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.523653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523663    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.523926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523682    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvtt\" (UniqueName: \"kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.523926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523762    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.523926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523792    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.523926 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.523879    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624447 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624416    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624771 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624482    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624771 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624508    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624771 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624531    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624771 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624547    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvtt\" (UniqueName: \"kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.624771 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624573    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.625060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624871    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.625060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624972    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.625060 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.624996    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.626816 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.626795    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.627090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.627071    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.632580 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.632529    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvtt\" (UniqueName: \"kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt\") pod \"sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") " pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.690462 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.690410    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:15.813869 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:15.813836    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:46:15.816525 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:46:15.816493    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb87bf21_41f3_4e0e_a50e_2f732aa309af.slice/crio-fe37e5069d4e2b49b6736dfeb8107adedbda6cf084e87b55e5dc4c0dd4fb2e0a WatchSource:0}: Error finding container fe37e5069d4e2b49b6736dfeb8107adedbda6cf084e87b55e5dc4c0dd4fb2e0a: Status 404 returned error can't find the container with id fe37e5069d4e2b49b6736dfeb8107adedbda6cf084e87b55e5dc4c0dd4fb2e0a
Jul 16 09:46:16.328893 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:16.328858    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" event={"ID":"eb87bf21-41f3-4e0e-a50e-2f732aa309af","Type":"ContainerStarted","Data":"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"}
Jul 16 09:46:16.328893 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:16.328900    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" event={"ID":"eb87bf21-41f3-4e0e-a50e-2f732aa309af","Type":"ContainerStarted","Data":"fe37e5069d4e2b49b6736dfeb8107adedbda6cf084e87b55e5dc4c0dd4fb2e0a"}
Jul 16 09:46:16.345868 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:16.345798    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" podStartSLOduration=1.345783574 podStartE2EDuration="1.345783574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:46:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:46:16.345023568 +0000 UTC m=+2474.038951009" watchObservedRunningTime="2026-07-16 09:46:16.345783574 +0000 UTC m=+2474.039711014"
Jul 16 09:46:22.914090 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:22.914040    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" podUID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" containerName="main" containerID="cri-o://f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f" gracePeriod=45
Jul 16 09:46:23.161681 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.161655    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:46:23.291190 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291102    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291190 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291169    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291206    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291226    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291260    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291307    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x42m\" (UniqueName: \"kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m\") pod \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\" (UID: \"903993f6-0ab2-4033-bbb5-e4283d43ce0e\") "
Jul 16 09:46:23.291595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291422    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache" (OuterVolumeSpecName: "model-cache") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:23.291595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291445    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:23.291595 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291463    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home" (OuterVolumeSpecName: "home") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:23.291782 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291618    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-model-cache\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:23.291782 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291636    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tmp-dir\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:23.291782 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.291649    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-home\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:23.293527 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.293499    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:46:23.293748 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.293538    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm" (OuterVolumeSpecName: "dshm") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:46:23.293748 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.293586    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m" (OuterVolumeSpecName: "kube-api-access-2x42m") pod "903993f6-0ab2-4033-bbb5-e4283d43ce0e" (UID: "903993f6-0ab2-4033-bbb5-e4283d43ce0e"). InnerVolumeSpecName "kube-api-access-2x42m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:46:23.358925 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.358887    2550 generic.go:356] "Generic (PLEG): container finished" podID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" containerID="f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f" exitCode=0
Jul 16 09:46:23.358925 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.358928    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"
Jul 16 09:46:23.359133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.358979    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" event={"ID":"903993f6-0ab2-4033-bbb5-e4283d43ce0e","Type":"ContainerDied","Data":"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"}
Jul 16 09:46:23.359133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.359030    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc" event={"ID":"903993f6-0ab2-4033-bbb5-e4283d43ce0e","Type":"ContainerDied","Data":"385d188b78db734f7b9383a9a8f723df6b220c14c3d8de376b19e1a888a782b8"}
Jul 16 09:46:23.359133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.359052    2550 scope.go:117] "RemoveContainer" containerID="f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"
Jul 16 09:46:23.367996 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.367977    2550 scope.go:117] "RemoveContainer" containerID="f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"
Jul 16 09:46:23.368248 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:46:23.368230    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f\": container with ID starting with f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f not found: ID does not exist" containerID="f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"
Jul 16 09:46:23.368321 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.368259    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f"} err="failed to get container status \"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f\": rpc error: code = NotFound desc = could not find container \"f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f\": container with ID starting with f966ee4fdfb962de41b0b08cb1f2b6e80ee86fcdb58c8495bb8c0726304b1c4f not found: ID does not exist"
Jul 16 09:46:23.382891 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.382867    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:46:23.385962 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.385930    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/auth-test-model-0b4ce8-kserve-75b5bd4f55-d95fc"]
Jul 16 09:46:23.392079 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.392052    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/903993f6-0ab2-4033-bbb5-e4283d43ce0e-tls-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:23.392197 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.392080    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x42m\" (UniqueName: \"kubernetes.io/projected/903993f6-0ab2-4033-bbb5-e4283d43ce0e-kube-api-access-2x42m\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:23.392197 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:23.392094    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/903993f6-0ab2-4033-bbb5-e4283d43ce0e-dshm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:46:24.864125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:24.864089    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" path="/var/lib/kubelet/pods/903993f6-0ab2-4033-bbb5-e4283d43ce0e/volumes"
Jul 16 09:46:25.690983 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:25.690949    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:25.691225 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:25.691005    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:25.702565 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:25.702540    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:46:26.382184 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:46:26.382145    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:47:23.871639 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:23.871605    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:47:38.890832 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:38.890785    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" podUID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" containerName="main" containerID="cri-o://b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483" gracePeriod=45
Jul 16 09:47:39.130573 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.130547    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:47:39.185913 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.185828    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:47:39.186116 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186101    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" containerName="main"
Jul 16 09:47:39.186116 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186117    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" containerName="main"
Jul 16 09:47:39.186237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186132    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" containerName="main"
Jul 16 09:47:39.186237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186138    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" containerName="main"
Jul 16 09:47:39.186237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186185    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" containerName="main"
Jul 16 09:47:39.186237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.186197    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="903993f6-0ab2-4033-bbb5-e4283d43ce0e" containerName="main"
Jul 16 09:47:39.188875 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.188860    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.191293 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.191273    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0b4ce8\"/\"rate-test-model-0b4ce8-kserve-self-signed-certs\""
Jul 16 09:47:39.200484 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.200459    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:47:39.212577 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212548    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.212709 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212679    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.212810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212793    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.212865 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212797    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:39.212910 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212874    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2zw6\" (UniqueName: \"kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.212950 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212920    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.212996 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212962    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.213031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.212996    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.213099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.213086    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tmp-dir\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.314105 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314055    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.314105 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314107    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.314370 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314219    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.314370 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314245    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pvtt\" (UniqueName: \"kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.314370 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314270    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm\") pod \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\" (UID: \"eb87bf21-41f3-4e0e-a50e-2f732aa309af\") "
Jul 16 09:47:39.314515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314382    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.314515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314410    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.314515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314392    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home" (OuterVolumeSpecName: "home") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:39.314515 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314475    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache" (OuterVolumeSpecName: "model-cache") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:39.314740 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314535    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2zw6\" (UniqueName: \"kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.314740 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314577    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.314740 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314627    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.314740 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314659    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.315020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314790    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-model-cache\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.315020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314801    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.315020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314813    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-home\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.315020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.314870    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.315225 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.315100    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.316496 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.316457    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:47:39.316601 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.316575    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm" (OuterVolumeSpecName: "dshm") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:47:39.317034 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.317003    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt" (OuterVolumeSpecName: "kube-api-access-2pvtt") pod "eb87bf21-41f3-4e0e-a50e-2f732aa309af" (UID: "eb87bf21-41f3-4e0e-a50e-2f732aa309af"). InnerVolumeSpecName "kube-api-access-2pvtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:47:39.317120 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.317062    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.317120 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.317064    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.322940 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.322921    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2zw6\" (UniqueName: \"kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6\") pod \"rate-test-model-0b4ce8-kserve-fc7fff987-g58ps\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") " pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.415938 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.415898    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pvtt\" (UniqueName: \"kubernetes.io/projected/eb87bf21-41f3-4e0e-a50e-2f732aa309af-kube-api-access-2pvtt\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.415938 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.415930    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb87bf21-41f3-4e0e-a50e-2f732aa309af-dshm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.415938 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.415942    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb87bf21-41f3-4e0e-a50e-2f732aa309af-tls-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:47:39.498934 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.498844    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:39.625620 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.625595    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:47:39.628002 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:47:39.627979    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e1b9c90_5b53_4b8f_b298_93ab4f69adac.slice/crio-8174d205e69aa0e1e2ecb514bbff1d57cac1c14b57040ad2d316f19ccbca28c3 WatchSource:0}: Error finding container 8174d205e69aa0e1e2ecb514bbff1d57cac1c14b57040ad2d316f19ccbca28c3: Status 404 returned error can't find the container with id 8174d205e69aa0e1e2ecb514bbff1d57cac1c14b57040ad2d316f19ccbca28c3
Jul 16 09:47:39.663958 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.663931    2550 generic.go:356] "Generic (PLEG): container finished" podID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" containerID="b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483" exitCode=0
Jul 16 09:47:39.664081 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.663984    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"
Jul 16 09:47:39.664081 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.664022    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" event={"ID":"eb87bf21-41f3-4e0e-a50e-2f732aa309af","Type":"ContainerDied","Data":"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"}
Jul 16 09:47:39.664081 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.664063    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs" event={"ID":"eb87bf21-41f3-4e0e-a50e-2f732aa309af","Type":"ContainerDied","Data":"fe37e5069d4e2b49b6736dfeb8107adedbda6cf084e87b55e5dc4c0dd4fb2e0a"}
Jul 16 09:47:39.664231 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.664082    2550 scope.go:117] "RemoveContainer" containerID="b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"
Jul 16 09:47:39.665408 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.665389    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" event={"ID":"5e1b9c90-5b53-4b8f-b298-93ab4f69adac","Type":"ContainerStarted","Data":"8174d205e69aa0e1e2ecb514bbff1d57cac1c14b57040ad2d316f19ccbca28c3"}
Jul 16 09:47:39.671991 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.671883    2550 scope.go:117] "RemoveContainer" containerID="b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"
Jul 16 09:47:39.672238 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:47:39.672217    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483\": container with ID starting with b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483 not found: ID does not exist" containerID="b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"
Jul 16 09:47:39.672286 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.672250    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483"} err="failed to get container status \"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483\": rpc error: code = NotFound desc = could not find container \"b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483\": container with ID starting with b201955bf5102da161148db97f4e99132911ae79630061534c48c4fc8db10483 not found: ID does not exist"
Jul 16 09:47:39.683930 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.683909    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:47:39.690256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:39.690233    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/sub-test-model-0b4ce8-kserve-74df5d8899-7gjqs"]
Jul 16 09:47:40.671633 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:40.671585    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" event={"ID":"5e1b9c90-5b53-4b8f-b298-93ab4f69adac","Type":"ContainerStarted","Data":"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"}
Jul 16 09:47:40.689494 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:40.689445    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" podStartSLOduration=1.689429173 podStartE2EDuration="1.689429173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:47:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:47:40.688458312 +0000 UTC m=+2558.382385735" watchObservedRunningTime="2026-07-16 09:47:40.689429173 +0000 UTC m=+2558.383356620"
Jul 16 09:47:40.863978 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:40.863945    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb87bf21-41f3-4e0e-a50e-2f732aa309af" path="/var/lib/kubelet/pods/eb87bf21-41f3-4e0e-a50e-2f732aa309af/volumes"
Jul 16 09:47:49.499202 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:49.499152    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:49.499202 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:49.499216    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:49.511431 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:49.511404    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:47:49.722989 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:47:49.722965    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:48:12.681691 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.681655    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:48:12.684795 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.684765    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.687158 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.687138    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"default-dockercfg-x6s97\""
Jul 16 09:48:12.687277 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.687138    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"openshift-service-ca.crt\""
Jul 16 09:48:12.688054 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.688032    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"kube-root-ca.crt\""
Jul 16 09:48:12.688164 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.688066    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8577c1\"/\"rate-test-model-8577c1-kserve-self-signed-certs\""
Jul 16 09:48:12.697311 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.697290    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:48:12.803635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803603    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8rds\" (UniqueName: \"kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.803842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803659    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.803842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803684    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.803842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803794    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.803976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803856    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.803976 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.803879    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904330 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904295    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904330 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904333    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904480    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8rds\" (UniqueName: \"kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904584 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904569    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904722 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904596    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904722 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904645    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904722 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904657    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904920 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904900    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.904986 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.904957    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.906541 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.906520    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.906970 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.906950    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.913103 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.913080    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8rds\" (UniqueName: \"kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds\") pod \"rate-test-model-8577c1-kserve-66fc487fff-5sp8m\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") " pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:12.994155 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:12.994059    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:13.121254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:13.121233    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:48:13.123736 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:48:13.123686    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67cfa2f7_4d90_40c7_a4a5_48db56b194fe.slice/crio-2715d8e1855a250a3842aad77e54cf4426819fccc2761e32383942ccffbef67c WatchSource:0}: Error finding container 2715d8e1855a250a3842aad77e54cf4426819fccc2761e32383942ccffbef67c: Status 404 returned error can't find the container with id 2715d8e1855a250a3842aad77e54cf4426819fccc2761e32383942ccffbef67c
Jul 16 09:48:13.813447 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:13.813414    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" event={"ID":"67cfa2f7-4d90-40c7-a4a5-48db56b194fe","Type":"ContainerStarted","Data":"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"}
Jul 16 09:48:13.813871 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:13.813457    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" event={"ID":"67cfa2f7-4d90-40c7-a4a5-48db56b194fe","Type":"ContainerStarted","Data":"2715d8e1855a250a3842aad77e54cf4426819fccc2761e32383942ccffbef67c"}
Jul 16 09:48:13.832013 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:13.831960    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" podStartSLOduration=1.831934189 podStartE2EDuration="1.831934189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:48:13.83040414 +0000 UTC m=+2591.524331604" watchObservedRunningTime="2026-07-16 09:48:13.831934189 +0000 UTC m=+2591.525861629"
Jul 16 09:48:22.995152 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:22.995095    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:22.995548 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:22.995164    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:23.007065 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:23.007041    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:23.866539 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:23.866506    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:48:58.333316 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:58.333282    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:48:59.161531 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:48:59.161500    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:49:13.351896 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.351834    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" podUID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" containerName="main" containerID="cri-o://99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7" gracePeriod=45
Jul 16 09:49:13.602250 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.602194    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:49:13.739826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739788    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.739826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739836    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2zw6\" (UniqueName: \"kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.740072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739875    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.740072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739893    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.740072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739944    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.740072 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.739994    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir\") pod \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\" (UID: \"5e1b9c90-5b53-4b8f-b298-93ab4f69adac\") "
Jul 16 09:49:13.740335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.740110    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home" (OuterVolumeSpecName: "home") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:13.740335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.740225    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:13.740335 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.740293    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-home\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:13.740715 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.740666    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:13.742204 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.742177    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6" (OuterVolumeSpecName: "kube-api-access-s2zw6") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "kube-api-access-s2zw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:13.742459 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.742440    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:49:13.742628 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.742599    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm" (OuterVolumeSpecName: "dshm") pod "5e1b9c90-5b53-4b8f-b298-93ab4f69adac" (UID: "5e1b9c90-5b53-4b8f-b298-93ab4f69adac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:13.840780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.840742    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-model-cache\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:13.840780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.840772    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-dshm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:13.840780 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.840783    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tmp-dir\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:13.841020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.840797    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2zw6\" (UniqueName: \"kubernetes.io/projected/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-kube-api-access-s2zw6\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:13.841020 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:13.840808    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e1b9c90-5b53-4b8f-b298-93ab4f69adac-tls-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.059353 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.059318    2550 generic.go:356] "Generic (PLEG): container finished" podID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" containerID="99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7" exitCode=0
Jul 16 09:49:14.059528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.059360    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"
Jul 16 09:49:14.059528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.059366    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" event={"ID":"5e1b9c90-5b53-4b8f-b298-93ab4f69adac","Type":"ContainerDied","Data":"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"}
Jul 16 09:49:14.059528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.059457    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps" event={"ID":"5e1b9c90-5b53-4b8f-b298-93ab4f69adac","Type":"ContainerDied","Data":"8174d205e69aa0e1e2ecb514bbff1d57cac1c14b57040ad2d316f19ccbca28c3"}
Jul 16 09:49:14.059528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.059477    2550 scope.go:117] "RemoveContainer" containerID="99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"
Jul 16 09:49:14.068104 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.068086    2550 scope.go:117] "RemoveContainer" containerID="99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"
Jul 16 09:49:14.068354 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:49:14.068336    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7\": container with ID starting with 99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7 not found: ID does not exist" containerID="99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"
Jul 16 09:49:14.068422 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.068363    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7"} err="failed to get container status \"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7\": rpc error: code = NotFound desc = could not find container \"99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7\": container with ID starting with 99e583d4ee6b618a933b05f53ce36659724f23c0ccc077e63633473b1baf75c7 not found: ID does not exist"
Jul 16 09:49:14.079586 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.079564    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:49:14.083501 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.083476    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0b4ce8/rate-test-model-0b4ce8-kserve-fc7fff987-g58ps"]
Jul 16 09:49:14.181099 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.181056    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" podUID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" containerName="main" containerID="cri-o://b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7" gracePeriod=45
Jul 16 09:49:14.428605 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.428581    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:49:14.446461 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.446433    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.446582 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.446474    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8rds\" (UniqueName: \"kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.446582 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.446508    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.446582 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.446522    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.446973 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.446943    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home" (OuterVolumeSpecName: "home") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:14.448899 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.448875    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds" (OuterVolumeSpecName: "kube-api-access-k8rds") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "kube-api-access-k8rds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:14.448998 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.448945    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm" (OuterVolumeSpecName: "dshm") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:14.448998 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.448968    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:49:14.547903 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.547871    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.547903 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.547907    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache\") pod \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\" (UID: \"67cfa2f7-4d90-40c7-a4a5-48db56b194fe\") "
Jul 16 09:49:14.548109 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548024    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-dshm\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.548109 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548036    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8rds\" (UniqueName: \"kubernetes.io/projected/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-kube-api-access-k8rds\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.548109 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548045    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tls-certs\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.548109 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548053    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-home\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.548227 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548143    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:14.548227 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.548190    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache" (OuterVolumeSpecName: "model-cache") pod "67cfa2f7-4d90-40c7-a4a5-48db56b194fe" (UID: "67cfa2f7-4d90-40c7-a4a5-48db56b194fe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 09:49:14.648937 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.648901    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-tmp-dir\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.648937 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.648931    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67cfa2f7-4d90-40c7-a4a5-48db56b194fe-model-cache\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:14.864635 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.864601    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" path="/var/lib/kubelet/pods/5e1b9c90-5b53-4b8f-b298-93ab4f69adac/volumes"
Jul 16 09:49:14.932496 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932410    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:14.932745 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932732    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" containerName="main"
Jul 16 09:49:14.932793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932749    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" containerName="main"
Jul 16 09:49:14.932793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932763    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" containerName="main"
Jul 16 09:49:14.932793 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932771    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" containerName="main"
Jul 16 09:49:14.932889 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932826    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1b9c90-5b53-4b8f-b298-93ab4f69adac" containerName="main"
Jul 16 09:49:14.932889 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.932833    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" containerName="main"
Jul 16 09:49:14.936005 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.935990    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:14.938467 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.938444    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nftdn\""
Jul 16 09:49:14.940133 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.940095    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:14.952307 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:14.951665    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqjsb\" (UniqueName: \"kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb\") pod \"test-curl-7358-140321205209392\" (UID: \"96436d71-b3c0-4379-8a51-010cb364ebd3\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:15.052336 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.052299    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqjsb\" (UniqueName: \"kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb\") pod \"test-curl-7358-140321205209392\" (UID: \"96436d71-b3c0-4379-8a51-010cb364ebd3\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:15.061029 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.061000    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqjsb\" (UniqueName: \"kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb\") pod \"test-curl-7358-140321205209392\" (UID: \"96436d71-b3c0-4379-8a51-010cb364ebd3\") " pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:15.064579 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.064554    2550 generic.go:356] "Generic (PLEG): container finished" podID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" containerID="b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7" exitCode=0
Jul 16 09:49:15.064726 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.064610    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"
Jul 16 09:49:15.064726 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.064626    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" event={"ID":"67cfa2f7-4d90-40c7-a4a5-48db56b194fe","Type":"ContainerDied","Data":"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"}
Jul 16 09:49:15.064726 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.064667    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m" event={"ID":"67cfa2f7-4d90-40c7-a4a5-48db56b194fe","Type":"ContainerDied","Data":"2715d8e1855a250a3842aad77e54cf4426819fccc2761e32383942ccffbef67c"}
Jul 16 09:49:15.064726 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.064684    2550 scope.go:117] "RemoveContainer" containerID="b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"
Jul 16 09:49:15.072216 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.072197    2550 scope.go:117] "RemoveContainer" containerID="b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"
Jul 16 09:49:15.072470 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:49:15.072451    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7\": container with ID starting with b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7 not found: ID does not exist" containerID="b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"
Jul 16 09:49:15.072524 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.072478    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7"} err="failed to get container status \"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7\": rpc error: code = NotFound desc = could not find container \"b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7\": container with ID starting with b8385f2d6bec426cb318636d99bd55ad8258aebbffd7546c495b18a7c9ac67b7 not found: ID does not exist"
Jul 16 09:49:15.079414 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.079394    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:49:15.085605 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.085571    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8577c1/rate-test-model-8577c1-kserve-66fc487fff-5sp8m"]
Jul 16 09:49:15.245786 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.245650    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:15.368030 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.367934    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:15.370773 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:49:15.370746    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96436d71_b3c0_4379_8a51_010cb364ebd3.slice/crio-3dc3e2fd210e8340414a3d3e6dd74f104eb1e21082a4f827d8fd3b57e408275a WatchSource:0}: Error finding container 3dc3e2fd210e8340414a3d3e6dd74f104eb1e21082a4f827d8fd3b57e408275a: Status 404 returned error can't find the container with id 3dc3e2fd210e8340414a3d3e6dd74f104eb1e21082a4f827d8fd3b57e408275a
Jul 16 09:49:15.372045 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:15.372024    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 09:49:16.071038 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:16.071006    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205209392" event={"ID":"96436d71-b3c0-4379-8a51-010cb364ebd3","Type":"ContainerStarted","Data":"3dc3e2fd210e8340414a3d3e6dd74f104eb1e21082a4f827d8fd3b57e408275a"}
Jul 16 09:49:16.863958 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:16.863920    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67cfa2f7-4d90-40c7-a4a5-48db56b194fe" path="/var/lib/kubelet/pods/67cfa2f7-4d90-40c7-a4a5-48db56b194fe/volumes"
Jul 16 09:49:17.077239 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:17.077208    2550 generic.go:356] "Generic (PLEG): container finished" podID="96436d71-b3c0-4379-8a51-010cb364ebd3" containerID="5d1a6e1034b1b9626b3ee3282bf0169b412ec8df73505986cda215b71c51b856" exitCode=0
Jul 16 09:49:17.077609 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:17.077260    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7358-140321205209392" event={"ID":"96436d71-b3c0-4379-8a51-010cb364ebd3","Type":"ContainerDied","Data":"5d1a6e1034b1b9626b3ee3282bf0169b412ec8df73505986cda215b71c51b856"}
Jul 16 09:49:18.205327 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.205297    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:18.242731 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.242684    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7358-140321205209392_96436d71-b3c0-4379-8a51-010cb364ebd3/test-curl-7358-140321205209392/0.log"
Jul 16 09:49:18.264768 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.264735    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:18.270854 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.270830    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7358-140321205209392"]
Jul 16 09:49:18.271606 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.271586    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqjsb\" (UniqueName: \"kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb\") pod \"96436d71-b3c0-4379-8a51-010cb364ebd3\" (UID: \"96436d71-b3c0-4379-8a51-010cb364ebd3\") "
Jul 16 09:49:18.273680 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.273653    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb" (OuterVolumeSpecName: "kube-api-access-fqjsb") pod "96436d71-b3c0-4379-8a51-010cb364ebd3" (UID: "96436d71-b3c0-4379-8a51-010cb364ebd3"). InnerVolumeSpecName "kube-api-access-fqjsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:18.372071 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.372038    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqjsb\" (UniqueName: \"kubernetes.io/projected/96436d71-b3c0-4379-8a51-010cb364ebd3-kube-api-access-fqjsb\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:18.863522 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:18.863495    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96436d71-b3c0-4379-8a51-010cb364ebd3" path="/var/lib/kubelet/pods/96436d71-b3c0-4379-8a51-010cb364ebd3/volumes"
Jul 16 09:49:19.086132 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:19.086103    2550 scope.go:117] "RemoveContainer" containerID="5d1a6e1034b1b9626b3ee3282bf0169b412ec8df73505986cda215b71c51b856"
Jul 16 09:49:19.086132 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:19.086127    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7358-140321205209392"
Jul 16 09:49:24.671610 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:24.671573    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:49:24.672061 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:24.671804    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" podUID="02f099fa-d79d-4547-bbfd-60686ec216a3" containerName="maas-api" containerID="cri-o://3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf" gracePeriod=30
Jul 16 09:49:24.912791 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:24.912768    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:49:25.024260 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.024175    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmbn7\" (UniqueName: \"kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7\") pod \"02f099fa-d79d-4547-bbfd-60686ec216a3\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") "
Jul 16 09:49:25.024260 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.024234    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca\") pod \"02f099fa-d79d-4547-bbfd-60686ec216a3\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") "
Jul 16 09:49:25.024260 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.024259    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") pod \"02f099fa-d79d-4547-bbfd-60686ec216a3\" (UID: \"02f099fa-d79d-4547-bbfd-60686ec216a3\") "
Jul 16 09:49:25.024628 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.024593    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02f099fa-d79d-4547-bbfd-60686ec216a3" (UID: "02f099fa-d79d-4547-bbfd-60686ec216a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:49:25.026255 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.026234    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02f099fa-d79d-4547-bbfd-60686ec216a3" (UID: "02f099fa-d79d-4547-bbfd-60686ec216a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:49:25.026361 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.026273    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7" (OuterVolumeSpecName: "kube-api-access-lmbn7") pod "02f099fa-d79d-4547-bbfd-60686ec216a3" (UID: "02f099fa-d79d-4547-bbfd-60686ec216a3"). InnerVolumeSpecName "kube-api-access-lmbn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:25.113283 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.113249    2550 generic.go:356] "Generic (PLEG): container finished" podID="02f099fa-d79d-4547-bbfd-60686ec216a3" containerID="3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf" exitCode=0
Jul 16 09:49:25.113442 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.113292    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"
Jul 16 09:49:25.113442 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.113328    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" event={"ID":"02f099fa-d79d-4547-bbfd-60686ec216a3","Type":"ContainerDied","Data":"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"}
Jul 16 09:49:25.113442 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.113383    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh" event={"ID":"02f099fa-d79d-4547-bbfd-60686ec216a3","Type":"ContainerDied","Data":"9ea9483bb2dd6a8c570d18316c64ed5e1f3b7f8427f7517da3c66a5bd07f826b"}
Jul 16 09:49:25.113442 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.113405    2550 scope.go:117] "RemoveContainer" containerID="3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"
Jul 16 09:49:25.121717 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.121685    2550 scope.go:117] "RemoveContainer" containerID="3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"
Jul 16 09:49:25.121969 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:49:25.121946    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf\": container with ID starting with 3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf not found: ID does not exist" containerID="3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"
Jul 16 09:49:25.122011 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.121978    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf"} err="failed to get container status \"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf\": rpc error: code = NotFound desc = could not find container \"3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf\": container with ID starting with 3a6d501d55a137ab5899b468daa48b3e2bb9a02dd92b5344333d9a4993d04fcf not found: ID does not exist"
Jul 16 09:49:25.125156 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.125138    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmbn7\" (UniqueName: \"kubernetes.io/projected/02f099fa-d79d-4547-bbfd-60686ec216a3-kube-api-access-lmbn7\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:25.125202 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.125158    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02f099fa-d79d-4547-bbfd-60686ec216a3-openshift-service-ca\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:25.125202 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.125168    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02f099fa-d79d-4547-bbfd-60686ec216a3-maas-api-tls\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:25.133536 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.133516    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:49:25.137530 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:25.137509    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0b4ce8-d7f4cb7c6-9xsmh"]
Jul 16 09:49:26.864075 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:26.864043    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02f099fa-d79d-4547-bbfd-60686ec216a3" path="/var/lib/kubelet/pods/02f099fa-d79d-4547-bbfd-60686ec216a3/volumes"
Jul 16 09:49:37.365261 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.365217    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:49:37.365751 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.365461    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" podUID="8445c00b-c8ac-48ba-b882-938da928e0a4" containerName="maas-api" containerID="cri-o://d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312" gracePeriod=30
Jul 16 09:49:37.606810 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.606789    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:49:37.732580 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.732504    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84trb\" (UniqueName: \"kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb\") pod \"8445c00b-c8ac-48ba-b882-938da928e0a4\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") "
Jul 16 09:49:37.732580 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.732562    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca\") pod \"8445c00b-c8ac-48ba-b882-938da928e0a4\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") "
Jul 16 09:49:37.732808 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.732604    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") pod \"8445c00b-c8ac-48ba-b882-938da928e0a4\" (UID: \"8445c00b-c8ac-48ba-b882-938da928e0a4\") "
Jul 16 09:49:37.732947 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.732919    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8445c00b-c8ac-48ba-b882-938da928e0a4" (UID: "8445c00b-c8ac-48ba-b882-938da928e0a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 09:49:37.734487 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.734459    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb" (OuterVolumeSpecName: "kube-api-access-84trb") pod "8445c00b-c8ac-48ba-b882-938da928e0a4" (UID: "8445c00b-c8ac-48ba-b882-938da928e0a4"). InnerVolumeSpecName "kube-api-access-84trb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 09:49:37.734575 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.734535    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8445c00b-c8ac-48ba-b882-938da928e0a4" (UID: "8445c00b-c8ac-48ba-b882-938da928e0a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 09:49:37.833252 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.833214    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8445c00b-c8ac-48ba-b882-938da928e0a4-openshift-service-ca\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:37.833252 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.833239    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8445c00b-c8ac-48ba-b882-938da928e0a4-maas-api-tls\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:37.833252 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:37.833248    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84trb\" (UniqueName: \"kubernetes.io/projected/8445c00b-c8ac-48ba-b882-938da928e0a4-kube-api-access-84trb\") on node \"ip-10-0-137-79.ec2.internal\" DevicePath \"\""
Jul 16 09:49:38.166418 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.166382    2550 generic.go:356] "Generic (PLEG): container finished" podID="8445c00b-c8ac-48ba-b882-938da928e0a4" containerID="d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312" exitCode=0
Jul 16 09:49:38.166590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.166429    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"
Jul 16 09:49:38.166590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.166445    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" event={"ID":"8445c00b-c8ac-48ba-b882-938da928e0a4","Type":"ContainerDied","Data":"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"}
Jul 16 09:49:38.166590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.166497    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5" event={"ID":"8445c00b-c8ac-48ba-b882-938da928e0a4","Type":"ContainerDied","Data":"7c73e7cfcdfeb8ba3da947b918205c539ce505a2b1c5b5ba198e22d3ac19b7ee"}
Jul 16 09:49:38.166590 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.166527    2550 scope.go:117] "RemoveContainer" containerID="d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"
Jul 16 09:49:38.174746 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.174727    2550 scope.go:117] "RemoveContainer" containerID="d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"
Jul 16 09:49:38.175012 ip-10-0-137-79 kubenswrapper[2550]: E0716 09:49:38.174993    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312\": container with ID starting with d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312 not found: ID does not exist" containerID="d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"
Jul 16 09:49:38.175077 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.175024    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312"} err="failed to get container status \"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312\": rpc error: code = NotFound desc = could not find container \"d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312\": container with ID starting with d3150aa4a74982adc8c8d0cdb31964600efd097648f3431fa649b1064f936312 not found: ID does not exist"
Jul 16 09:49:38.187108 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.187085    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:49:38.191125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.191105    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-8577c1-69898dfbc6-jrtj5"]
Jul 16 09:49:38.863842 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:38.863810    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8445c00b-c8ac-48ba-b882-938da928e0a4" path="/var/lib/kubelet/pods/8445c00b-c8ac-48ba-b882-938da928e0a4/volumes"
Jul 16 09:49:44.551136 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:44.551106    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85985554b8-5f45f_4ab84b8c-8e05-4061-b1e6-9aa7211de94b/authorino/0.log"
Jul 16 09:49:50.854553 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:50.854517    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mv68z_2afc2545-423a-4a2b-82bd-ed52977eedc1/copy-manifests/0.log"
Jul 16 09:49:50.862658 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:50.862628    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mv68z_2afc2545-423a-4a2b-82bd-ed52977eedc1/manager/0.log"
Jul 16 09:49:52.871045 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:52.871006    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85985554b8-5f45f_4ab84b8c-8e05-4061-b1e6-9aa7211de94b/authorino/0.log"
Jul 16 09:49:54.120587 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:54.120560    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r86mk_70b6f6fc-fecf-48d0-85e7-b96a7165e16c/istio-proxy/0.log"
Jul 16 09:49:54.476173 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:54.476091    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-nzgvg_5c1dced4-a2b7-40df-99fc-8dfd6267d0e5/kube-auth-proxy/0.log"
Jul 16 09:49:54.594743 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:54.594717    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/1.log"
Jul 16 09:49:55.914429 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:49:55.914358    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5pgxw_aab4a994-452d-4149-b8a7-4789131f11b7/main/0.log"
Jul 16 09:50:01.388053 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388007    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc7d7/must-gather-25n6r"]
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388439    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8445c00b-c8ac-48ba-b882-938da928e0a4" containerName="maas-api"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388469    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8445c00b-c8ac-48ba-b882-938da928e0a4" containerName="maas-api"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388502    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02f099fa-d79d-4547-bbfd-60686ec216a3" containerName="maas-api"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388510    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="02f099fa-d79d-4547-bbfd-60686ec216a3" containerName="maas-api"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388524    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96436d71-b3c0-4379-8a51-010cb364ebd3" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388534    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="96436d71-b3c0-4379-8a51-010cb364ebd3" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388617    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="96436d71-b3c0-4379-8a51-010cb364ebd3" containerName="test-curl-7358-140321205209392"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388631    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="02f099fa-d79d-4547-bbfd-60686ec216a3" containerName="maas-api"
Jul 16 09:50:01.388679 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.388641    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8445c00b-c8ac-48ba-b882-938da928e0a4" containerName="maas-api"
Jul 16 09:50:01.393237 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.393213    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.395653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.395605    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc7d7\"/\"openshift-service-ca.crt\""
Jul 16 09:50:01.395653 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.395614    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xc7d7\"/\"kube-root-ca.crt\""
Jul 16 09:50:01.396512 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.396494    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xc7d7\"/\"default-dockercfg-54m6m\""
Jul 16 09:50:01.401307 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.401281    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/must-gather-25n6r"]
Jul 16 09:50:01.501826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.501760    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwbsq\" (UniqueName: \"kubernetes.io/projected/41a02534-b0c6-405a-9ea3-a6980a0d0421-kube-api-access-mwbsq\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.501826 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.501793    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41a02534-b0c6-405a-9ea3-a6980a0d0421-must-gather-output\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.602922 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.602895    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwbsq\" (UniqueName: \"kubernetes.io/projected/41a02534-b0c6-405a-9ea3-a6980a0d0421-kube-api-access-mwbsq\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.603031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.602927    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41a02534-b0c6-405a-9ea3-a6980a0d0421-must-gather-output\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.603222 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.603206    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/41a02534-b0c6-405a-9ea3-a6980a0d0421-must-gather-output\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.611052 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.611021    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwbsq\" (UniqueName: \"kubernetes.io/projected/41a02534-b0c6-405a-9ea3-a6980a0d0421-kube-api-access-mwbsq\") pod \"must-gather-25n6r\" (UID: \"41a02534-b0c6-405a-9ea3-a6980a0d0421\") " pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.703482 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.703416    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/must-gather-25n6r"
Jul 16 09:50:01.834889 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:01.834861    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/must-gather-25n6r"]
Jul 16 09:50:01.835877 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:50:01.835852    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41a02534_b0c6_405a_9ea3_a6980a0d0421.slice/crio-cbfb9c704d652c7b9ad91a204e175b5270234da43655fc7c32d36bef7b89495c WatchSource:0}: Error finding container cbfb9c704d652c7b9ad91a204e175b5270234da43655fc7c32d36bef7b89495c: Status 404 returned error can't find the container with id cbfb9c704d652c7b9ad91a204e175b5270234da43655fc7c32d36bef7b89495c
Jul 16 09:50:02.268835 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:02.268805    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/must-gather-25n6r" event={"ID":"41a02534-b0c6-405a-9ea3-a6980a0d0421","Type":"ContainerStarted","Data":"cbfb9c704d652c7b9ad91a204e175b5270234da43655fc7c32d36bef7b89495c"}
Jul 16 09:50:03.276264 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:03.276220    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/must-gather-25n6r" event={"ID":"41a02534-b0c6-405a-9ea3-a6980a0d0421","Type":"ContainerStarted","Data":"ff8f1fddd39ecfdf2b1f8738c0b6f2aff2fa66df3b2b3c54d2ccd36cd2c7503b"}
Jul 16 09:50:03.276734 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:03.276288    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/must-gather-25n6r" event={"ID":"41a02534-b0c6-405a-9ea3-a6980a0d0421","Type":"ContainerStarted","Data":"ad397d4fc8557e42b9607bcb5616402305ae7f5055e5cc55549861aef7525455"}
Jul 16 09:50:03.292962 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:03.292867    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc7d7/must-gather-25n6r" podStartSLOduration=1.377319777 podStartE2EDuration="2.292851885s" totalImagesPullingTime="915.532108ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:50:03.291712363 +0000 UTC m=+2700.985639798" watchObservedRunningTime="2026-07-16 09:50:03.292851885 +0000 UTC m=+2700.986779326"
Jul 16 09:50:04.399552 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:04.399514    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hrq68_d27c408d-862b-4972-8c5c-6290c2b725f1/global-pull-secret-syncer/0.log"
Jul 16 09:50:04.593138 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:04.593106    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w8b8c_d5e4d02a-3dc6-48f2-b3cb-a9f60fd70985/konnectivity-agent/0.log"
Jul 16 09:50:04.706539 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:04.706464    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-79.ec2.internal_fb2f2f9ee8258d42945cd1eb17f2050c/haproxy/0.log"
Jul 16 09:50:09.371528 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:09.371486    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85985554b8-5f45f_4ab84b8c-8e05-4061-b1e6-9aa7211de94b/authorino/0.log"
Jul 16 09:50:11.922987 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:11.922955    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vszvf_49055876-30dd-4959-af97-5ef40864c1a2/node-exporter/0.log"
Jul 16 09:50:11.958036 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:11.957997    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vszvf_49055876-30dd-4959-af97-5ef40864c1a2/kube-rbac-proxy/0.log"
Jul 16 09:50:11.988514 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:11.988481    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vszvf_49055876-30dd-4959-af97-5ef40864c1a2/init-textfile/0.log"
Jul 16 09:50:13.704898 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.704839    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"]
Jul 16 09:50:13.710507 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.710477    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.716899 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.716871    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"]
Jul 16 09:50:13.817474 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.817431    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7jgc\" (UniqueName: \"kubernetes.io/projected/31d0f109-6acf-4c80-a462-6beaa6ce6955-kube-api-access-c7jgc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.817674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.817494    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-podres\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.817674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.817534    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-sys\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.817674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.817590    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-lib-modules\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.817674 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.817629    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-proc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.918397 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.918358    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7jgc\" (UniqueName: \"kubernetes.io/projected/31d0f109-6acf-4c80-a462-6beaa6ce6955-kube-api-access-c7jgc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.919050 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919027    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-podres\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.919254 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919238    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-sys\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.919479 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919462    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-lib-modules\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.919777 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919760    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-proc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.919995 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919676    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-lib-modules\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.920074 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919329    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-podres\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.920074 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919394    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-sys\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.920074 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.919915    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/31d0f109-6acf-4c80-a462-6beaa6ce6955-proc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:13.926979 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:13.926964    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7jgc\" (UniqueName: \"kubernetes.io/projected/31d0f109-6acf-4c80-a462-6beaa6ce6955-kube-api-access-c7jgc\") pod \"perf-node-gather-daemonset-h7cxb\" (UID: \"31d0f109-6acf-4c80-a462-6beaa6ce6955\") " pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:14.024369 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:14.024278    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:14.215075 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:14.214980    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"]
Jul 16 09:50:14.221979 ip-10-0-137-79 kubenswrapper[2550]: W0716 09:50:14.221953    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod31d0f109_6acf_4c80_a462_6beaa6ce6955.slice/crio-88c0ea1e77ea20d2dbc3530155e5ff8b67ddacedc6342ccf54d53fb11d60b466 WatchSource:0}: Error finding container 88c0ea1e77ea20d2dbc3530155e5ff8b67ddacedc6342ccf54d53fb11d60b466: Status 404 returned error can't find the container with id 88c0ea1e77ea20d2dbc3530155e5ff8b67ddacedc6342ccf54d53fb11d60b466
Jul 16 09:50:14.344948 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:14.344864    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb" event={"ID":"31d0f109-6acf-4c80-a462-6beaa6ce6955","Type":"ContainerStarted","Data":"88c0ea1e77ea20d2dbc3530155e5ff8b67ddacedc6342ccf54d53fb11d60b466"}
Jul 16 09:50:14.898904 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:14.898872    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-pb27c_7085f5f1-1126-408d-80eb-e6efe36fd2b9/download-server/0.log"
Jul 16 09:50:15.352289 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:15.352211    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb" event={"ID":"31d0f109-6acf-4c80-a462-6beaa6ce6955","Type":"ContainerStarted","Data":"6497e5c250d98582aea4cffb6daae49ca4c201ed52e41281fc740d061194d8d6"}
Jul 16 09:50:15.353441 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:15.353419    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:15.368164 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:15.368116    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb" podStartSLOduration=2.368100429 podStartE2EDuration="2.368100429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:50:15.368005615 +0000 UTC m=+2713.061933056" watchObservedRunningTime="2026-07-16 09:50:15.368100429 +0000 UTC m=+2713.062027870"
Jul 16 09:50:16.584383 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:16.584352    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vx95c_a6244f24-34cc-4ed2-924f-5a4554868559/dns/0.log"
Jul 16 09:50:16.607650 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:16.607621    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vx95c_a6244f24-34cc-4ed2-924f-5a4554868559/kube-rbac-proxy/0.log"
Jul 16 09:50:16.660827 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:16.660803    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hvqdv_7fb741ad-738b-4c37-91ca-9f4e7cea123e/dns-node-resolver/0.log"
Jul 16 09:50:17.239786 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:17.239749    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c87b5bc9-kl5kc_36d4a3ac-9c1c-4776-9bcd-53bf840914f7/registry/0.log"
Jul 16 09:50:17.267655 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:17.267604    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gdsjt_4967901f-de92-48f8-a7fb-b4f5bc3ba144/node-ca/0.log"
Jul 16 09:50:18.231396 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:18.231367    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r86mk_70b6f6fc-fecf-48d0-85e7-b96a7165e16c/istio-proxy/0.log"
Jul 16 09:50:18.469105 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:18.469077    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-nzgvg_5c1dced4-a2b7-40df-99fc-8dfd6267d0e5/kube-auth-proxy/0.log"
Jul 16 09:50:18.501944 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:18.501868    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/0.log"
Jul 16 09:50:18.536031 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:18.536000    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/1.log"
Jul 16 09:50:19.329229 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:19.329203    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfvv2_29df0134-df10-48d8-89d4-6885c4a17d1b/serve-healthcheck-canary/0.log"
Jul 16 09:50:20.113812 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:20.113778    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvjqq_557dafc6-d789-433b-9d6f-3fd710e52e5c/kube-rbac-proxy/0.log"
Jul 16 09:50:20.139028 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:20.139000    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvjqq_557dafc6-d789-433b-9d6f-3fd710e52e5c/exporter/0.log"
Jul 16 09:50:20.164423 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:20.164396    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rvjqq_557dafc6-d789-433b-9d6f-3fd710e52e5c/extractor/0.log"
Jul 16 09:50:22.376125 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:22.376101    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xc7d7/perf-node-gather-daemonset-h7cxb"
Jul 16 09:50:22.951624 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:22.951597    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mv68z_2afc2545-423a-4a2b-82bd-ed52977eedc1/manager/0.log"
Jul 16 09:50:22.991433 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:22.991402    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d64bd87c6-mv68z_2afc2545-423a-4a2b-82bd-ed52977eedc1/copy-manifests/0.log"
Jul 16 09:50:23.376058 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:23.376029    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r86mk_70b6f6fc-fecf-48d0-85e7-b96a7165e16c/istio-proxy/0.log"
Jul 16 09:50:23.669085 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:23.669000    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-nzgvg_5c1dced4-a2b7-40df-99fc-8dfd6267d0e5/kube-auth-proxy/0.log"
Jul 16 09:50:23.773256 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:23.773224    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/0.log"
Jul 16 09:50:23.804761 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:23.804689    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/1.log"
Jul 16 09:50:24.321451 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:24.321422    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ddb4bcd65-69dm2_6bbc26f1-4eb7-4711-97a6-922cc5b8cdea/manager/0.log"
Jul 16 09:50:25.258503 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:25.258433    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r86mk_70b6f6fc-fecf-48d0-85e7-b96a7165e16c/istio-proxy/0.log"
Jul 16 09:50:25.495008 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:25.494978    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86ccb4d5cb-nzgvg_5c1dced4-a2b7-40df-99fc-8dfd6267d0e5/kube-auth-proxy/0.log"
Jul 16 09:50:25.526029 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:25.525947    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/0.log"
Jul 16 09:50:25.558242 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:25.558212    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r58rl_f5e0d2ee-a73b-46a3-94ab-a6f607804af9/istio-proxy/1.log"
Jul 16 09:50:31.026534 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.026504    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/kube-multus-additional-cni-plugins/0.log"
Jul 16 09:50:31.052045 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.052014    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/egress-router-binary-copy/0.log"
Jul 16 09:50:31.077428 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.077402    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/cni-plugins/0.log"
Jul 16 09:50:31.103113 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.103090    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/bond-cni-plugin/0.log"
Jul 16 09:50:31.128250 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.128228    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/routeoverride-cni/0.log"
Jul 16 09:50:31.154733 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.154690    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/whereabouts-cni-bincopy/0.log"
Jul 16 09:50:31.183493 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.183463    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hbkbp_ceb5c6f4-253a-4ffb-b78b-41cd09fceb3b/whereabouts-cni/0.log"
Jul 16 09:50:31.625840 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.625806    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hmgjn_ccc440bf-6733-4a53-999f-cb09ce38c661/kube-multus/0.log"
Jul 16 09:50:31.701260 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.701231    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hhgz_ec102fe0-31ab-4f36-bd89-479b15643e15/network-metrics-daemon/0.log"
Jul 16 09:50:31.724645 ip-10-0-137-79 kubenswrapper[2550]: I0716 09:50:31.724562    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hhgz_ec102fe0-31ab-4f36-bd89-479b15643e15/kube-rbac-proxy/0.log"