Jul 12 16:24:59.862223 ip-10-0-132-101 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 16:25:00.238437 ip-10-0-132-101 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 16:25:00.238437 ip-10-0-132-101 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 16:25:00.238437 ip-10-0-132-101 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 16:25:00.238437 ip-10-0-132-101 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 16:25:00.238437 ip-10-0-132-101 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 16:25:00.239318 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.238502    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246174    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246199    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246204    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246208    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246211    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.246204 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246214    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246217    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246220    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246223    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246226    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246230    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246232    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246235    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246238    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246241    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246244    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246247    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246249    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246252    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246255    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246258    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246260    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246263    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246266    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246275    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.246415 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246279    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246281    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246284    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246287    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246290    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246293    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246296    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246298    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246300    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246303    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246306    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246308    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246310    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246315    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246321    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246324    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246327    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246330    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246332    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.246880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246335    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246337    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246340    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246343    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246345    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246347    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246350    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246352    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246355    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246359    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246363    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246365    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246368    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246371    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246374    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246376    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246379    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246382    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246384    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.247451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246386    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246389    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246391    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246394    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246397    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246399    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246402    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246405    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246409    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246411    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246414    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246417    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246419    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246422    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246425    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246427    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246430    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246432    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246435    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246437    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.247907 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246440    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246443    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246445    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246448    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246450    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246453    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246456    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246458    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246461    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246466    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246470    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246473    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246476    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246478    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246481    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.246483    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247210    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247217    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247220    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247223    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.248404 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247227    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247230    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247233    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247236    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247238    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247241    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247244    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247247    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247250    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247252    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247255    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247258    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247260    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247270    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247273    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247276    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247279    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247281    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247283    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247286    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.248894 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247288    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247291    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247294    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247296    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247298    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247301    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247303    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247306    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247310    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247314    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247317    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247320    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247324    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247327    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247330    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247334    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247337    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247340    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247343    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.249382 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247346    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247349    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247352    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247354    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247357    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247360    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247362    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247365    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247367    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247370    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247372    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247375    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247377    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247380    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247382    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247385    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247387    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247390    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247392    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247395    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.249836 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247397    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247401    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247403    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247406    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247408    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247412    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247416    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247418    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247423    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247425    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247428    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247430    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247432    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247435    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247437    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247440    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247442    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247445    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247447    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.250318 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247449    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247453    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247455    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247458    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247461    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247464    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247466    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247469    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247471    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247474    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247476    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247479    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247482    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247484    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247487    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247489    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247493    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247952    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247959    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247962    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.250777 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247965    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247968    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247971    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247975    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247978    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247981    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247984    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247987    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247990    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247993    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247995    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.247998    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248000    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248003    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248006    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248009    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248011    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248014    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248016    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.251291 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248019    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248021    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248023    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248026    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248029    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248031    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248034    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248036    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248039    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248041    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248044    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248047    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248050    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248055    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248058    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248061    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248064    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248067    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248069    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.251734 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248072    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248075    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248077    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248081    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248083    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248086    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248088    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248091    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248093    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248096    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248098    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248101    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248104    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248106    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248108    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248111    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248113    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248116    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248119    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248122    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.252200 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248124    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248126    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248129    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248132    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248135    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248138    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248142    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248145    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248148    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248150    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248153    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248155    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248158    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248160    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248163    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248165    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248167    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248170    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248172    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248175    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.252712 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248177    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248180    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248182    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248185    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248189    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248191    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248193    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248196    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248199    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248201    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248204    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248207    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248209    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248211    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248214    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248216    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248219    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248222    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248303    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248313    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248323    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 16:25:00.253197 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248329    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248335    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248339    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248343    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248348    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248351    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248354    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248358    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248361    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248364    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248367    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248370    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248373    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248377    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248380    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248384    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248387    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248390    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248393    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248397    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248400    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248403    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248407    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 16:25:00.253696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248410    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248413    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248416    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248424    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248427    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248430    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248435    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248438    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248441    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248444    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248447    2577 flags.go:64] FLAG: --enable-server="true"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248450    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248455    2577 flags.go:64] FLAG: --event-burst="100"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248459    2577 flags.go:64] FLAG: --event-qps="50"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248461    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248465    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248468    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248471    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248474    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248477    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248480    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248483    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248487    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248490    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248493    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 16:25:00.254275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248496    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248499    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248501    2577 flags.go:64] FLAG: --feature-gates=""
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248506    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248509    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248512    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248515    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248518    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248521    2577 flags.go:64] FLAG: --help="false"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248524    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-101.ec2.internal"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248529    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248532    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248535    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248538    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248541    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248544    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248547    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248550    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248553    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248556    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248559    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248562    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248565    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248568    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 16:25:00.254894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248571    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248574    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248577    2577 flags.go:64] FLAG: --lock-file=""
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248579    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248582    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248585    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248590    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248594    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248597    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248600    2577 flags.go:64] FLAG: --logging-format="text"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248603    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248606    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248609    2577 flags.go:64] FLAG: --manifest-url=""
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248612    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248616    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248619    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248623    2577 flags.go:64] FLAG: --max-pods="110"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248626    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248630    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248633    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248636    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248639    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248642    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248645    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248652    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 16:25:00.255475 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248655    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248658    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248662    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248673    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248679    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248682    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248686    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248689    2577 flags.go:64] FLAG: --port="10250"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248692    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248695    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ce600a8d470a4d6"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248698    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248701    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248704    2577 flags.go:64] FLAG: --register-node="true"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248706    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248710    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248713    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248716    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248720    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248725    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248728    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248731    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248733    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248736    2577 flags.go:64] FLAG: --runonce="false"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248739    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248742    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 16:25:00.256105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248745    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248749    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248752    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248755    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248758    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248761    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248764    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248767    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248770    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248773    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248776    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248779    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248782    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248787    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248790    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248793    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248797    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248799    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248802    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248805    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248808    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248811    2577 flags.go:64] FLAG: --v="2"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248815    2577 flags.go:64] FLAG: --version="false"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248820    2577 flags.go:64] FLAG: --vmodule=""
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248825    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 16:25:00.256725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.248828    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248964    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248969    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248972    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248976    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248978    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248981    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248984    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248988    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248991    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248994    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248997    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.248999    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249002    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249004    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249007    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249010    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249012    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249015    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249018    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.257352 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249020    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249023    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249026    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249029    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249032    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249034    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249037    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249040    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249042    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249045    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249047    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249052    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249054    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249057    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249060    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249062    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249065    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249067    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249071    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249075    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.257890 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249080    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249083    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249085    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249088    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249091    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249095    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249098    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249102    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249105    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249107    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249110    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249113    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249116    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249119    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249123    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249126    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249128    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249131    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249134    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249137    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.258380 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249139    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249142    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249145    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249149    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249152    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249155    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249157    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249160    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249162    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249164    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249167    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249170    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249174    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249177    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249179    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249182    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249184    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249187    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249189    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249192    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.258889 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249194    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249197    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249200    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249202    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249205    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249207    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249210    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249214    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249217    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249220    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249222    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249224    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249227    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249230    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249232    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249236    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249239    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249242    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.259373 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249244    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.249247    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.249925    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.257107    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.257128    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.258163    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.258175    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258255    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258261    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258265    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258268    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258271    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258273    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258276    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.259819 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258279    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258282    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258284    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258288    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258291    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258293    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258296    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258299    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258301    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258304    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258307    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258310    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258312    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258315    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258317    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258320    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258322    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258326    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258328    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258331    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.260193 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258334    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258336    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258339    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258342    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258345    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258347    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258350    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258352    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258355    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258357    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258360    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258362    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258365    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258367    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258370    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258373    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258375    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258378    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258380    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258383    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.260696 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258386    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258391    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258395    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258398    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258401    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258404    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258407    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258410    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258413    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258415    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258419    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258422    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258424    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258427    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258430    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258433    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258436    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258439    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258441    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.261185 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258444    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258446    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258449    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258453    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258456    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258459    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258462    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258465    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258467    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258470    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258472    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258475    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258477    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258480    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258483    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258485    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258489    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258493    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258497    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258499    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.261656 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258502    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258505    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258507    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258510    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258520    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258523    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258526    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258528    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258531    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258534    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258536    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258538    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258541    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.258547    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258698    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 16:25:00.262146 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258702    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258705    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258709    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258713    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258716    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258719    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258722    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258724    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258727    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258730    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258732    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258735    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258737    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258740    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258742    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258745    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258748    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258751    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258754    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258756    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 16:25:00.262513 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258758    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258761    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258769    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258772    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258775    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258778    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258780    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258783    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258785    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258788    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258790    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258793    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258796    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258798    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258801    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258803    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258806    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258808    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258810    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258813    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 16:25:00.263010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258815    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258818    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258820    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258823    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258825    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258828    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258831    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258833    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258836    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258838    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258842    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258845    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258849    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258851    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258854    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258874    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258878    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258881    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258883    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 16:25:00.263484 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258886    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258889    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258892    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258894    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258903    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258906    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258908    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258911    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258913    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258917    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258920    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258923    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258927    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258929    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258932    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258935    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258938    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258940    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258943    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 16:25:00.263963 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258945    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258948    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258950    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258953    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258956    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258958    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258961    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258963    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258966    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258968    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258976    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258979    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258982    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258984    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258987    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258989    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258991    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258994    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258996    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 16:25:00.264426 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:00.258999    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.259004    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.259132    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.261353    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.262858    2577 server.go:1019] "Starting client certificate rotation"
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.262970    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 16:25:00.264949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.263014    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 16:25:00.265650 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.265635    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 16:25:00.272147 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.272122    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 16:25:00.280397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.280377    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 12 16:25:00.283358 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.283342    2577 log.go:25] "Validated CRI v1 image API"
Jul 12 16:25:00.284844 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.284801    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 16:25:00.287228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.287208    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ba7cfeac-fbdb-4cd7-a05e-f7faee1495ef:/dev/nvme0n1p3 d345fd4e-b3dc-4d72-8835-b9f946504e1e:/dev/nvme0n1p4]
Jul 12 16:25:00.287282 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.287228    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 16:25:00.290323 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.290303    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 16:25:00.292252 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.292145    2577 manager.go:216] Machine: {Timestamp:2026-07-12 16:25:00.290977738 +0000 UTC m=+0.316481882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101558 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200d189e2d64208087bdfe487e9110 SystemUUID:ec200d18-9e2d-6420-8087-bdfe487e9110 BootID:db5c4ef6-d4b6-4367-853a-0c2ee4bfacb1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:1c:f9:a6:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:1c:f9:a6:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:a2:e8:0e:77:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 16:25:00.292252 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.292246    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 16:25:00.292363 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.292343    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 16:25:00.295390 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.295352    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 16:25:00.295537 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.295393    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 16:25:00.296661 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.296649    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 16:25:00.296698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.296663    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 16:25:00.296698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.296671    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 16:25:00.297477 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.297465    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 16:25:00.298354 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.298343    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 16:25:00.301953 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.301939    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 16:25:00.302084 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302075    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 16:25:00.302123 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302110    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 16:25:00.302150 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302122    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 16:25:00.302150 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302140    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 16:25:00.302150 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302149    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 12 16:25:00.302227 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302159    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 16:25:00.302552 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302539    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 16:25:00.302598 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.302558    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 16:25:00.304655 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.304635    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 16:25:00.306946 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.306928    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 16:25:00.307023 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.306960    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 16:25:00.307684 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307670    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 16:25:00.307719 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307692    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 16:25:00.307751 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307722    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 16:25:00.307751 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307737    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 16:25:00.307751 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307747    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307754    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307762    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307768    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307778    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307785    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307802    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 16:25:00.307825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.307810    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 16:25:00.309512 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.309497    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 16:25:00.309555 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.309525    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 16:25:00.311905 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.311884    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 16:25:00.311905 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.311893    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 16:25:00.312043 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.312005    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 16:25:00.313049 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.313035    2577 server.go:1268] "Started kubelet"
Jul 12 16:25:00.313145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.313108    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 16:25:00.313198 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.313138    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 16:25:00.313241 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.313218    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 16:25:00.313903 ip-10-0-132-101 systemd[1]: Started Kubernetes Kubelet.
Jul 12 16:25:00.314514 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.314427    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 16:25:00.315207 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.315194    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 16:25:00.318823 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.318801    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 16:25:00.320379 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.320362    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 16:25:00.320452 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.320429    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 16:25:00.321030 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.320443    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:00.321030 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.319829    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-101.ec2.internal.18c1977f4663a660  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-101.ec2.internal,UID:ip-10-0-132-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-101.ec2.internal,},FirstTimestamp:2026-07-12 16:25:00.313003616 +0000 UTC m=+0.338507760,LastTimestamp:2026-07-12 16:25:00.313003616 +0000 UTC m=+0.338507760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-101.ec2.internal,}"
Jul 12 16:25:00.321030 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321012    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 16:25:00.321030 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321030    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 16:25:00.321268 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321054    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 16:25:00.321268 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321168    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 16:25:00.321268 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321176    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 16:25:00.321443 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321425    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 16:25:00.321513 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321445    2577 factory.go:55] Registering systemd factory
Jul 12 16:25:00.321513 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321455    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 12 16:25:00.321726 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321710    2577 factory.go:153] Registering CRI-O factory
Jul 12 16:25:00.321726 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321726    2577 factory.go:223] Registration of the crio container factory successfully
Jul 12 16:25:00.321855 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321744    2577 factory.go:103] Registering Raw factory
Jul 12 16:25:00.321855 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.321756    2577 manager.go:1196] Started watching for new ooms in manager
Jul 12 16:25:00.322237 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.322225    2577 manager.go:349] Starting recovery of all containers
Jul 12 16:25:00.328464 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.328432    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 16:25:00.328626 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.328566    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 16:25:00.333339 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.333312    2577 manager.go:354] Recovery completed
Jul 12 16:25:00.338489 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.338472    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:00.340818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.340797    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brtsl"
Jul 12 16:25:00.340916 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.340851    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:00.340916 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.340892    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:00.340916 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.340904    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:00.341451 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.341435    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 16:25:00.341451 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.341441    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:00.341451 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.341448    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 16:25:00.341642 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.341469    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 16:25:00.342120 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.342106    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:00.342184 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.342132    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:00.342184 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.342142    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:00.343070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.342989    2577 policy_none.go:49] "None policy: Start"
Jul 12 16:25:00.343070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.343004    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 16:25:00.343070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.343016    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 16:25:00.344145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.344134    2577 policy_none.go:47] "Start"
Jul 12 16:25:00.346828 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.346633    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brtsl"
Jul 12 16:25:00.349266 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.349196    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-101.ec2.internal.18c1977f480cfb9a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-101.ec2.internal,UID:ip-10-0-132-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-101.ec2.internal,},FirstTimestamp:2026-07-12 16:25:00.340878234 +0000 UTC m=+0.366382379,LastTimestamp:2026-07-12 16:25:00.340878234 +0000 UTC m=+0.366382379,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-101.ec2.internal,}"
Jul 12 16:25:00.351149 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.351078    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-101.ec2.internal.18c1977f480d488e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-101.ec2.internal,UID:ip-10-0-132-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-101.ec2.internal,},FirstTimestamp:2026-07-12 16:25:00.340897934 +0000 UTC m=+0.366402078,LastTimestamp:2026-07-12 16:25:00.340897934 +0000 UTC m=+0.366402078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-101.ec2.internal,}"
Jul 12 16:25:00.390591 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.390567    2577 manager.go:337] "Starting Device Plugin manager"
Jul 12 16:25:00.390741 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.390627    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 16:25:00.390741 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.390643    2577 server.go:87] "Starting device plugin registration server"
Jul 12 16:25:00.391009 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.390994    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 16:25:00.391073 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.391012    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 16:25:00.391129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.391116    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 16:25:00.391239 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.391221    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 16:25:00.391239 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.391233    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 16:25:00.391718 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.391695    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 16:25:00.391795 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.391749    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:00.456816 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.456771    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 16:25:00.458015 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.457983    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 16:25:00.458015 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.458016    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 16:25:00.458147 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.458045    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 16:25:00.458147 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:00.458078    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 16:25:00.460350 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.460333    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 16:25:00.491191 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.491111    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:00.492127 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.492109    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:00.492216 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.492146    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:00.492216 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.492160    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:00.492216 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:00.492183    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.666251 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.666222    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.666251 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.666246    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-101.ec2.internal\": node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:02.725872 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.725827    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"]
Jul 12 16:25:02.726087 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.725929    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:02.726169 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.726141    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:02.726930 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.726898    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:02.726930 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.726926    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:02.727062 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.726949    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:02.728256 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.728244    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:02.728377 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.728359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.728498 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.728390    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:02.729014 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.728998    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:02.729100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.729023    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:02.729100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.729033    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:02.729100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.728998    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:02.729238 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.729114    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:02.729238 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.729133    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:02.730661 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.730644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.730761 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.730688    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 16:25:02.731448 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.731429    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 16:25:02.731546 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.731463    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 16:25:02.731546 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.731495    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeHasSufficientPID"
Jul 12 16:25:02.755302 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.755275    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-101.ec2.internal\" not found" node="ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.759654 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.759638    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-101.ec2.internal\" not found" node="ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.791303 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.791275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.791412 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.791310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9808c0a499f17cc6f6e482e1dbd2adfa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-101.ec2.internal\" (UID: \"9808c0a499f17cc6f6e482e1dbd2adfa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.791412 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.791390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.826240 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.826213    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:02.891899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.891856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.891959 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.891914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.891959 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.891938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9808c0a499f17cc6f6e482e1dbd2adfa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-101.ec2.internal\" (UID: \"9808c0a499f17cc6f6e482e1dbd2adfa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.892064 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.891956    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.892064 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.891988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9808c0a499f17cc6f6e482e1dbd2adfa-config\") pod \"kube-apiserver-proxy-ip-10-0-132-101.ec2.internal\" (UID: \"9808c0a499f17cc6f6e482e1dbd2adfa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.892064 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:02.892020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693d0fabeb3edc2ccb12eab94498fe87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal\" (UID: \"693d0fabeb3edc2ccb12eab94498fe87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:02.927036 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:02.926964    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.027831 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.027797    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.058710 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.058680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:03.063177 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.062946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:03.128264 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.128223    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.228940 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.228865    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.329392 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.329352    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.429931 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.429894    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-101.ec2.internal\" not found"
Jul 12 16:25:03.429931 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.429921    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 16:25:03.430379 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.430084    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 16:25:03.459539 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.459513    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 16:25:03.470370 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.470346    2577 apiserver.go:52] "Watching apiserver"
Jul 12 16:25:03.483763 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.483687    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 16:25:03.484742 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.484721    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-c782j","openshift-network-diagnostics/network-check-target-rxmnn","openshift-ovn-kubernetes/ovnkube-node-jrr97","kube-system/konnectivity-agent-n8rnf","openshift-cluster-node-tuning-operator/tuned-dptv7","openshift-image-registry/node-ca-m277f","openshift-network-operator/iptables-alerter-xjctw","kube-system/global-pull-secret-syncer-ldc5s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56","openshift-dns/node-resolver-6cztp","openshift-multus/multus-8tt59","openshift-multus/multus-additional-cni-plugins-7glcg"]
Jul 12 16:25:03.486456 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.486438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.486568 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.486535    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:03.487625 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.487605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:03.487726 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.487668    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:03.488316 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.488300    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:03.488925 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.488912    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 16:25:03.489129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.489112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.490407 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.490389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.491005 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.490990    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 16:25:03.491300 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 16:25:03.491407 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491390    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 16:25:03.491754 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491736    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fxblm\""
Jul 12 16:25:03.491818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.491818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491786    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.491818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 16:25:03.491956 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.491866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.492436 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.492422    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 16:25:03.492513 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.492466    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7qc49\""
Jul 12 16:25:03.492793 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.492776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 16:25:03.493342 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.493328    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.494647 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.494894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494754    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.494894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494767    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494921    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6qrhb\""
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-slash\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-ovn\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.494979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-bin\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-kubelet\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-systemd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-netd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-script-lib\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/777d7576-e163-42c3-9ce4-cc0995083db5-agent-certs\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/777d7576-e163-42c3-9ce4-cc0995083db5-konnectivity-ca\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-netns\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqjv\" (UniqueName: \"kubernetes.io/projected/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-kube-api-access-qfqjv\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-systemd-units\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-config\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-etc-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-node-log\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-log-socket\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-env-overrides\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3581a437-1425-4c3d-9645-809ce92c6c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86qk5\" (UniqueName: \"kubernetes.io/projected/3581a437-1425-4c3d-9645-809ce92c6c0f-kube-api-access-86qk5\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-var-lib-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5h4bs\""
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495544    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.495630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495556    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 16:25:03.496045 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.495835    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.496045 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.496011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.496116 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.496070    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:03.497361 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.497337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.497361 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.497361    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 16:25:03.497503 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.497373    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.497765 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.497750    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.497863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.497849    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4lkgm\""
Jul 12 16:25:03.499846 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.499135    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.500054 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.500035    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.500134 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.500118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v9qnj\""
Jul 12 16:25:03.500341 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.500324    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.500788 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.500767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 16:25:03.501240 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.501219    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 16:25:03.501360 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.501346    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"
Jul 12 16:25:03.502491 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.502018    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.502491 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.502377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h4xhp\""
Jul 12 16:25:03.502621 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.502500    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.502755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.502742    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.504871 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.504689    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 16:25:03.504871 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.504758    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal"]
Jul 12 16:25:03.504871 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.504865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.505530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.505515    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j8tt6\""
Jul 12 16:25:03.505694 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.505679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 16:25:03.505896 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.505876    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 16:25:03.505965 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.505905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 16:25:03.506153 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.506140    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 16:25:03.506766 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.506752    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 16:25:03.506961 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.506943    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 16:25:03.507177 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.507165    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4fg8w\""
Jul 12 16:25:03.509649 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.509635    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 16:25:03.509749 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.509735    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal"]
Jul 12 16:25:03.519111 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.519069    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 16:20:02 +0000 UTC" deadline="2028-03-04 08:34:29.739524442 +0000 UTC"
Jul 12 16:25:03.519111 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.519105    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14416h9m26.220421237s"
Jul 12 16:25:03.535453 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.535435    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqx95"
Jul 12 16:25:03.542159 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.542137    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqx95"
Jul 12 16:25:03.590250 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.590224    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 16:25:03.596363 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-kubelet\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596446 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.596446 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-host\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.596446 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-socket-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-kubelet\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-node-log\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-node-log\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-bin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5429\" (UniqueName: \"kubernetes.io/projected/654d16c2-805b-4dbf-bba9-027d267bcf6e-kube-api-access-t5429\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.596606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-system-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-k8s-cni-cncf-io\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysconfig\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-serviceca\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-etc-selinux\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhn9\" (UniqueName: \"kubernetes.io/projected/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kube-api-access-cnhn9\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-cnibin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.596894 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-conf-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cnibin\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-tuned\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tl7\" (UniqueName: \"kubernetes.io/projected/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-kube-api-access-25tl7\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-env-overrides\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.596994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86qk5\" (UniqueName: \"kubernetes.io/projected/3581a437-1425-4c3d-9645-809ce92c6c0f-kube-api-access-86qk5\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2r26\" (UniqueName: \"kubernetes.io/projected/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-kube-api-access-t2r26\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-lib-modules\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-log-socket\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-log-socket\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-cni-binary-copy\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-socket-dir-parent\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-netns\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-os-release\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-env-overrides\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-kubelet\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-daemon-config\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-slash\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-slash\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-ovn\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxrq\" (UniqueName: \"kubernetes.io/projected/89057664-7631-465a-a2cc-a8266aa8ef21-kube-api-access-tdxrq\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-netd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-ovn\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-netd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/777d7576-e163-42c3-9ce4-cc0995083db5-konnectivity-ca\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-run\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-sys\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597753    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-tmp\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.597792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99ea5434-3f49-441a-a919-83cb02ab36e2-host-slash\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-config\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3581a437-1425-4c3d-9645-809ce92c6c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-device-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.597951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-multus\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.598013    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-modprobe-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-kubernetes\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqrn5\" (UniqueName: \"kubernetes.io/projected/99ea5434-3f49-441a-a919-83cb02ab36e2-kube-api-access-tqrn5\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/777d7576-e163-42c3-9ce4-cc0995083db5-agent-certs\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.598385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:04.098356063 +0000 UTC m=+1.956249436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/777d7576-e163-42c3-9ce4-cc0995083db5-konnectivity-ca\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.598615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-sys-fs\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-config\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89057664-7631-465a-a2cc-a8266aa8ef21-hosts-file\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-etc-kubernetes\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ksc\" (UniqueName: \"kubernetes.io/projected/04b5511a-a2f2-4ce3-9960-d37d8598e144-kube-api-access-f4ksc\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-dbus\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598611    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-systemd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-run-systemd\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-script-lib\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-registration-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-os-release\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-systemd\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-var-lib-kubelet\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-netns\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfqjv\" (UniqueName: \"kubernetes.io/projected/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-kube-api-access-qfqjv\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.599315 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-systemd-units\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-run-netns\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-hostroot\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.598966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-host\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-systemd-units\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-kubelet-config\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-etc-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-etc-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-conf\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-multus-certs\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3581a437-1425-4c3d-9645-809ce92c6c0f-ovnkube-script-lib\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-var-lib-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-bin\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-var-lib-openvswitch\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600001 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89057664-7631-465a-a2cc-a8266aa8ef21-tmp-dir\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.600471 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3581a437-1425-4c3d-9645-809ce92c6c0f-host-cni-bin\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.600471 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.600471 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.599781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99ea5434-3f49-441a-a919-83cb02ab36e2-iptables-alerter-script\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.601714 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.601695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3581a437-1425-4c3d-9645-809ce92c6c0f-ovn-node-metrics-cert\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.601918 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.601897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/777d7576-e163-42c3-9ce4-cc0995083db5-agent-certs\") pod \"konnectivity-agent-n8rnf\" (UID: \"777d7576-e163-42c3-9ce4-cc0995083db5\") " pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.605075 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.605057    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:03.605173 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.605080    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:03.605173 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.605093    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:03.605272 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.605202    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:04.105185345 +0000 UTC m=+1.963078724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:03.607253 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.607236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86qk5\" (UniqueName: \"kubernetes.io/projected/3581a437-1425-4c3d-9645-809ce92c6c0f-kube-api-access-86qk5\") pod \"ovnkube-node-jrr97\" (UID: \"3581a437-1425-4c3d-9645-809ce92c6c0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.607663 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.607639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfqjv\" (UniqueName: \"kubernetes.io/projected/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-kube-api-access-qfqjv\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:03.658719 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.658672    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 16:25:03.700879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-os-release\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.700879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-kubelet\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-daemon-config\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxrq\" (UniqueName: \"kubernetes.io/projected/89057664-7631-465a-a2cc-a8266aa8ef21-kube-api-access-tdxrq\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-kubelet\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-os-release\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.700999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-run\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-sys\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-tmp\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-sys\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99ea5434-3f49-441a-a919-83cb02ab36e2-host-slash\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.701118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-run\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99ea5434-3f49-441a-a919-83cb02ab36e2-host-slash\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-device-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-multus\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-multus\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-device-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-modprobe-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-kubernetes\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-system-cni-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqrn5\" (UniqueName: \"kubernetes.io/projected/99ea5434-3f49-441a-a919-83cb02ab36e2-kube-api-access-tqrn5\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-sys-fs\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-kubernetes\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89057664-7631-465a-a2cc-a8266aa8ef21-hosts-file\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-etc-kubernetes\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.701708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ksc\" (UniqueName: \"kubernetes.io/projected/04b5511a-a2f2-4ce3-9960-d37d8598e144-kube-api-access-f4ksc\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-sys-fs\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-dbus\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-registration-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-etc-kubernetes\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89057664-7631-465a-a2cc-a8266aa8ef21-hosts-file\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-os-release\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-dbus\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-systemd\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-os-release\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-modprobe-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-registration-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-systemd\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-var-lib-kubelet\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-var-lib-kubelet\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-hostroot\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-host\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.702497 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-kubelet-config\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.701813    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-hostroot\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-host\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-kubelet-config\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:03.701877    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:04.201860332 +0000 UTC m=+2.059753704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-conf\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-multus-certs\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89057664-7631-465a-a2cc-a8266aa8ef21-tmp-dir\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.701984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99ea5434-3f49-441a-a919-83cb02ab36e2-iptables-alerter-script\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-host\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-socket-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-conf\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-bin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5429\" (UniqueName: \"kubernetes.io/projected/654d16c2-805b-4dbf-bba9-027d267bcf6e-kube-api-access-t5429\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysctl-d\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-system-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-system-cni-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-k8s-cni-cncf-io\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89057664-7631-465a-a2cc-a8266aa8ef21-tmp-dir\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysconfig\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702326    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-var-lib-cni-bin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-serviceca\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-etc-selinux\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-multus-certs\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhn9\" (UniqueName: \"kubernetes.io/projected/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kube-api-access-cnhn9\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-cnibin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-conf-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cnibin\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.703970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-tuned\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25tl7\" (UniqueName: \"kubernetes.io/projected/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-kube-api-access-25tl7\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2r26\" (UniqueName: \"kubernetes.io/projected/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-kube-api-access-t2r26\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-host\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-sysconfig\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/99ea5434-3f49-441a-a919-83cb02ab36e2-iptables-alerter-script\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cnibin\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-lib-modules\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-cnibin\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-cni-binary-copy\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-socket-dir-parent\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-conf-dir\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-k8s-cni-cncf-io\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-socket-dir\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-netns\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.702935    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-socket-dir-parent\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.704492 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/654d16c2-805b-4dbf-bba9-027d267bcf6e-host-run-netns\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04b5511a-a2f2-4ce3-9960-d37d8598e144-lib-modules\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703270    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-etc-selinux\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-multus-daemon-config\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-serviceca\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/654d16c2-805b-4dbf-bba9-027d267bcf6e-cni-binary-copy\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.703743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-tmp\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.705026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.704749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04b5511a-a2f2-4ce3-9960-d37d8598e144-etc-tuned\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.708913 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.708891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqrn5\" (UniqueName: \"kubernetes.io/projected/99ea5434-3f49-441a-a919-83cb02ab36e2-kube-api-access-tqrn5\") pod \"iptables-alerter-xjctw\" (UID: \"99ea5434-3f49-441a-a919-83cb02ab36e2\") " pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.710432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.710405    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxrq\" (UniqueName: \"kubernetes.io/projected/89057664-7631-465a-a2cc-a8266aa8ef21-kube-api-access-tdxrq\") pod \"node-resolver-6cztp\" (UID: \"89057664-7631-465a-a2cc-a8266aa8ef21\") " pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.711327 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.711301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ksc\" (UniqueName: \"kubernetes.io/projected/04b5511a-a2f2-4ce3-9960-d37d8598e144-kube-api-access-f4ksc\") pod \"tuned-dptv7\" (UID: \"04b5511a-a2f2-4ce3-9960-d37d8598e144\") " pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.711412 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.711353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tl7\" (UniqueName: \"kubernetes.io/projected/c59f85eb-f22c-4e06-8bfb-d7a1a933d084-kube-api-access-25tl7\") pod \"node-ca-m277f\" (UID: \"c59f85eb-f22c-4e06-8bfb-d7a1a933d084\") " pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.711504 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.711467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5429\" (UniqueName: \"kubernetes.io/projected/654d16c2-805b-4dbf-bba9-027d267bcf6e-kube-api-access-t5429\") pod \"multus-8tt59\" (UID: \"654d16c2-805b-4dbf-bba9-027d267bcf6e\") " pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.711551 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.711471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2r26\" (UniqueName: \"kubernetes.io/projected/24d22bcd-295e-4ff5-a7bd-9e874e60e8c0-kube-api-access-t2r26\") pod \"multus-additional-cni-plugins-7glcg\" (UID: \"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0\") " pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.711585 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.711564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhn9\" (UniqueName: \"kubernetes.io/projected/62d6bdf9-d27b-4fc7-983f-58dd93cd0763-kube-api-access-cnhn9\") pod \"aws-ebs-csi-driver-node-4qm56\" (UID: \"62d6bdf9-d27b-4fc7-983f-58dd93cd0763\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.721383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.721362    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 16:25:03.733880 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.733794    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693d0fabeb3edc2ccb12eab94498fe87.slice/crio-8b32e6068a8faba374d4c79423df3d76ef77631d2639f86a8777e8349f9512b9 WatchSource:0}: Error finding container 8b32e6068a8faba374d4c79423df3d76ef77631d2639f86a8777e8349f9512b9: Status 404 returned error can't find the container with id 8b32e6068a8faba374d4c79423df3d76ef77631d2639f86a8777e8349f9512b9
Jul 12 16:25:03.739338 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.739321    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 16:25:03.812073 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.812045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9808c0a499f17cc6f6e482e1dbd2adfa.slice/crio-1b5aab87c5f1221a04963ad2a176d92b038cdf072edb4321a6b5c9e3da4c71da WatchSource:0}: Error finding container 1b5aab87c5f1221a04963ad2a176d92b038cdf072edb4321a6b5c9e3da4c71da: Status 404 returned error can't find the container with id 1b5aab87c5f1221a04963ad2a176d92b038cdf072edb4321a6b5c9e3da4c71da
Jul 12 16:25:03.819162 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.819130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:03.833018 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.833000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:03.839540 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.839514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dptv7"
Jul 12 16:25:03.841010 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.840985    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777d7576_e163_42c3_9ce4_cc0995083db5.slice/crio-96e0e83e3157866bef31e21bfd3012706620b370940b16c4f3d6f8a8565598c0 WatchSource:0}: Error finding container 96e0e83e3157866bef31e21bfd3012706620b370940b16c4f3d6f8a8565598c0: Status 404 returned error can't find the container with id 96e0e83e3157866bef31e21bfd3012706620b370940b16c4f3d6f8a8565598c0
Jul 12 16:25:03.847148 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.847120    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b5511a_a2f2_4ce3_9960_d37d8598e144.slice/crio-4010464f462d3642fa46b8c21fb662f300c3f302c876cf03c2038e9b7e569644 WatchSource:0}: Error finding container 4010464f462d3642fa46b8c21fb662f300c3f302c876cf03c2038e9b7e569644: Status 404 returned error can't find the container with id 4010464f462d3642fa46b8c21fb662f300c3f302c876cf03c2038e9b7e569644
Jul 12 16:25:03.867832 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.867802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m277f"
Jul 12 16:25:03.875507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.875466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xjctw"
Jul 12 16:25:03.875807 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.875786    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59f85eb_f22c_4e06_8bfb_d7a1a933d084.slice/crio-97247793f0383e3623fa0f34c255a37ea7913a1f079b7b16ca55bfbee2176f78 WatchSource:0}: Error finding container 97247793f0383e3623fa0f34c255a37ea7913a1f079b7b16ca55bfbee2176f78: Status 404 returned error can't find the container with id 97247793f0383e3623fa0f34c255a37ea7913a1f079b7b16ca55bfbee2176f78
Jul 12 16:25:03.891321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.891299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56"
Jul 12 16:25:03.898967 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.898942    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d6bdf9_d27b_4fc7_983f_58dd93cd0763.slice/crio-f92c6147f0d9446a8aa83e7f1d7adc4e83f2bdd0e3ba891b8473f07835ece7da WatchSource:0}: Error finding container f92c6147f0d9446a8aa83e7f1d7adc4e83f2bdd0e3ba891b8473f07835ece7da: Status 404 returned error can't find the container with id f92c6147f0d9446a8aa83e7f1d7adc4e83f2bdd0e3ba891b8473f07835ece7da
Jul 12 16:25:03.902660 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.902559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cztp"
Jul 12 16:25:03.912863 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.912839    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89057664_7631_465a_a2cc_a8266aa8ef21.slice/crio-d024d99a31e07624cd0bee542eac7b9db3155289c92fdf88a9440bc24e30d36d WatchSource:0}: Error finding container d024d99a31e07624cd0bee542eac7b9db3155289c92fdf88a9440bc24e30d36d: Status 404 returned error can't find the container with id d024d99a31e07624cd0bee542eac7b9db3155289c92fdf88a9440bc24e30d36d
Jul 12 16:25:03.926745 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.926705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8tt59"
Jul 12 16:25:03.934499 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.934453    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654d16c2_805b_4dbf_bba9_027d267bcf6e.slice/crio-ad876601c4e33f8160fb6ed4626c4b9baa852f70fcd38a2015d5e18e349e545d WatchSource:0}: Error finding container ad876601c4e33f8160fb6ed4626c4b9baa852f70fcd38a2015d5e18e349e545d: Status 404 returned error can't find the container with id ad876601c4e33f8160fb6ed4626c4b9baa852f70fcd38a2015d5e18e349e545d
Jul 12 16:25:03.935720 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:03.935690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7glcg"
Jul 12 16:25:03.943045 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:03.943023    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d22bcd_295e_4ff5_a7bd_9e874e60e8c0.slice/crio-077b7f93e9d8ccfa03e009d8bcf2f0b7da2d726449fdffee0d4f0f4236af82aa WatchSource:0}: Error finding container 077b7f93e9d8ccfa03e009d8bcf2f0b7da2d726449fdffee0d4f0f4236af82aa: Status 404 returned error can't find the container with id 077b7f93e9d8ccfa03e009d8bcf2f0b7da2d726449fdffee0d4f0f4236af82aa
Jul 12 16:25:04.106040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.105952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:04.106040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.105992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:04.106247 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106103    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:04.106247 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106161    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:05.106146934 +0000 UTC m=+2.964040300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:04.106247 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106193    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:04.106247 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106213    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:04.106247 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106226    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:04.106514 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.106275    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:05.106260512 +0000 UTC m=+2.964153894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:04.207004 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.206958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:04.207176 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.207108    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:04.207235 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.207181    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:05.207162361 +0000 UTC m=+3.065055728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:04.543989 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.543852    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:20:03 +0000 UTC" deadline="2028-01-06 12:50:22.140790311 +0000 UTC"
Jul 12 16:25:04.543989 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.543940    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13028h25m17.596855599s"
Jul 12 16:25:04.603880 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.603655    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 16:25:04.628784 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.628753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:04.628938 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:04.628895    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:04.673616 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.673558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dptv7" event={"ID":"04b5511a-a2f2-4ce3-9960-d37d8598e144","Type":"ContainerStarted","Data":"4010464f462d3642fa46b8c21fb662f300c3f302c876cf03c2038e9b7e569644"}
Jul 12 16:25:04.702065 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.702027    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n8rnf" event={"ID":"777d7576-e163-42c3-9ce4-cc0995083db5","Type":"ContainerStarted","Data":"96e0e83e3157866bef31e21bfd3012706620b370940b16c4f3d6f8a8565598c0"}
Jul 12 16:25:04.716133 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.716097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"42cd69cf216b4bec232aee1f8ba578857214d26954417837055ae2acc12d58c8"}
Jul 12 16:25:04.737740 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.737702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cztp" event={"ID":"89057664-7631-465a-a2cc-a8266aa8ef21","Type":"ContainerStarted","Data":"d024d99a31e07624cd0bee542eac7b9db3155289c92fdf88a9440bc24e30d36d"}
Jul 12 16:25:04.748220 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.748180    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56" event={"ID":"62d6bdf9-d27b-4fc7-983f-58dd93cd0763","Type":"ContainerStarted","Data":"f92c6147f0d9446a8aa83e7f1d7adc4e83f2bdd0e3ba891b8473f07835ece7da"}
Jul 12 16:25:04.767200 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.767163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xjctw" event={"ID":"99ea5434-3f49-441a-a919-83cb02ab36e2","Type":"ContainerStarted","Data":"f998e90102d94745c2777e87e305c4052c7d8fb8bcf646ddb3c95c4537cd6c7f"}
Jul 12 16:25:04.782072 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.781995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal" event={"ID":"9808c0a499f17cc6f6e482e1dbd2adfa","Type":"ContainerStarted","Data":"1b5aab87c5f1221a04963ad2a176d92b038cdf072edb4321a6b5c9e3da4c71da"}
Jul 12 16:25:04.798528 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.798168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal" event={"ID":"693d0fabeb3edc2ccb12eab94498fe87","Type":"ContainerStarted","Data":"8b32e6068a8faba374d4c79423df3d76ef77631d2639f86a8777e8349f9512b9"}
Jul 12 16:25:04.820818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.820778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerStarted","Data":"077b7f93e9d8ccfa03e009d8bcf2f0b7da2d726449fdffee0d4f0f4236af82aa"}
Jul 12 16:25:04.836131 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.836096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8tt59" event={"ID":"654d16c2-805b-4dbf-bba9-027d267bcf6e","Type":"ContainerStarted","Data":"ad876601c4e33f8160fb6ed4626c4b9baa852f70fcd38a2015d5e18e349e545d"}
Jul 12 16:25:04.859124 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:04.858987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m277f" event={"ID":"c59f85eb-f22c-4e06-8bfb-d7a1a933d084","Type":"ContainerStarted","Data":"97247793f0383e3623fa0f34c255a37ea7913a1f079b7b16ca55bfbee2176f78"}
Jul 12 16:25:05.113467 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.113368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:05.113467 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.113422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:05.113704 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113626    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:05.113704 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113645    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:05.113704 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113657    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:05.113863 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113713    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:07.113696663 +0000 UTC m=+4.971590053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:05.113863 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113786    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:05.113863 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.113816    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:07.113806152 +0000 UTC m=+4.971699524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:05.214581 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.214542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:05.214761 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.214729    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:05.214828 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.214794    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:07.214775444 +0000 UTC m=+5.072668826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:05.544334 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.544123    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 16:20:03 +0000 UTC" deadline="2028-04-18 08:44:54.38812659 +0000 UTC"
Jul 12 16:25:05.544334 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.544164    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15496h19m48.843967085s"
Jul 12 16:25:05.626052 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.626024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:05.626230 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.626150    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:05.626526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:05.626505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:05.626625 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:05.626607    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:06.626837 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:06.626568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:06.626837 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:06.626717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:07.133024 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:07.132979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:07.133024 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:07.133029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:07.133276 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133193    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:07.133276 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133212    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:07.133276 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133224    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:07.133413 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133279    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:11.133261953 +0000 UTC m=+8.991155335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:07.133728 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133707    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:07.133887 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.133767    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:11.133750718 +0000 UTC m=+8.991644084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:07.236876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:07.236321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:07.236876 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.236465    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:07.236876 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.236543    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:11.236524786 +0000 UTC m=+9.094418165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:07.626102 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:07.626020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:07.626258 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.626163    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:07.626258 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:07.626212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:07.626366 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:07.626321    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:08.626938 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:08.626905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:08.627382 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:08.627048    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:09.626230 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:09.626184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:09.626412 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:09.626313    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:09.626854 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:09.626715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:09.626854 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:09.626810    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:10.627118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:10.626878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:10.627118 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:10.627031    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:11.170673 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:11.170620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:11.170673 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:11.170670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170798    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170840    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170860    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170871    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170872    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:19.170854417 +0000 UTC m=+17.028747800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:11.170927 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.170910    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:19.170897914 +0000 UTC m=+17.028791278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:11.271827 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:11.271778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:11.272024 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.271936    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:11.272024 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.272001    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:19.271982324 +0000 UTC m=+17.129875692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:11.626866 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:11.626159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:11.626866 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.626301    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:11.626866 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:11.626685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:11.626866 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:11.626780    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:12.627403 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:12.627369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:12.627890 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:12.627525    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:13.626400 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:13.626281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:13.626400 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:13.626288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:13.626656 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:13.626412    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:13.626656 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:13.626507    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:14.626076 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:14.625875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:14.626506 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:14.626198    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:15.626713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:15.626676    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:15.626713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:15.626715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:15.627114 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:15.626798    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:15.627114 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:15.626910    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:16.626275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:16.626236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:16.626467 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:16.626362    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:17.626006 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:17.625965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:17.626441 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:17.625986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:17.626441 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:17.626095    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:17.626441 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:17.626167    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:18.628925 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:18.628899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:18.629327 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:18.629018    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:19.238443 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:19.238409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:19.238443 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:19.238447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:19.238661 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238584    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:19.238661 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238598    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:19.238661 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238613    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:19.238661 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238627    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:19.238661 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238651    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:25:35.238633016 +0000 UTC m=+33.096526400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:19.238814 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.238668    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:25:35.238659837 +0000 UTC m=+33.096553213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:19.339847 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:19.339811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:19.340031 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.339970    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:19.340094 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.340046    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:25:35.340027504 +0000 UTC m=+33.197920883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:19.626118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:19.626000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:19.626118 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:19.626058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:19.626372 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.626147    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:19.626372 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:19.626222    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:20.626791 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:20.626754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:20.627213 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:20.626883    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:21.626512 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:21.626456    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:21.626512 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:21.626497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:21.626752 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:21.626595    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:21.626752 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:21.626711    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:22.627404 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:22.627368    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:22.627872 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:22.627502    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:23.626831 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:23.626799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:23.627007 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:23.626799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:23.627007 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:23.626909    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:23.627007 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:23.626980    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:24.626240 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.626208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:24.626683 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:24.626352    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:24.920148 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.919841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal" event={"ID":"9808c0a499f17cc6f6e482e1dbd2adfa","Type":"ContainerStarted","Data":"206631214c9030ab58ce8e76b63b603c258afc29d68321201284e9e62be4d3b4"}
Jul 12 16:25:24.921565 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.921540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8tt59" event={"ID":"654d16c2-805b-4dbf-bba9-027d267bcf6e","Type":"ContainerStarted","Data":"e8569b3ac510a42eaeac97119a18db753af78ad289c7fb43e09219fd91a843a1"}
Jul 12 16:25:24.923059 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.923031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dptv7" event={"ID":"04b5511a-a2f2-4ce3-9960-d37d8598e144","Type":"ContainerStarted","Data":"076ec923a3d1a0085b17e6ba2b015917f3405ca61009822fc66b99febffaabb8"}
Jul 12 16:25:24.925835 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.925818    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:24.926132 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.926112    2577 generic.go:356] "Generic (PLEG): container finished" podID="3581a437-1425-4c3d-9645-809ce92c6c0f" containerID="5f4954ae49941825d63033b0875ee3bf67703d1c7830b37547336618869f540e" exitCode=1
Jul 12 16:25:24.926228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.926145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"24f6c6736623544a043a9c3f14330ea0cff7263989b4be79a95dd4467953580e"}
Jul 12 16:25:24.926228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.926211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"bbe8388bbfbef294a5744037d3775dd987e8a87ff9981470487fe3dd4a715a2a"}
Jul 12 16:25:24.926343 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.926261    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerDied","Data":"5f4954ae49941825d63033b0875ee3bf67703d1c7830b37547336618869f540e"}
Jul 12 16:25:24.926343 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.926312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"5c6b744d17688c9ed4fdc58abdc15f65213211f9d6dba52b6dae82b0759de086"}
Jul 12 16:25:24.933910 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.933868    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-101.ec2.internal" podStartSLOduration=21.933856392 podStartE2EDuration="21.933856392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:24.933793218 +0000 UTC m=+22.791686602" watchObservedRunningTime="2026-07-12 16:25:24.933856392 +0000 UTC m=+22.791749779"
Jul 12 16:25:24.967047 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.967005    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dptv7" podStartSLOduration=2.865219577 podStartE2EDuration="22.966984935s" totalImagesPullingTime="20.101765358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:24.950282534 +0000 UTC m=+22.808175922" watchObservedRunningTime="2026-07-12 16:25:24.966984935 +0000 UTC m=+22.824878321"
Jul 12 16:25:24.967416 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:24.967343    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8tt59" podStartSLOduration=2.944567569 podStartE2EDuration="22.967337425s" totalImagesPullingTime="20.022769856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:24.966754546 +0000 UTC m=+22.824647935" watchObservedRunningTime="2026-07-12 16:25:24.967337425 +0000 UTC m=+22.825230811"
Jul 12 16:25:25.626455 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.626145    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:25.627330 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.626192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:25.627330 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:25.626534    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:25.627330 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:25.626585    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:25.929114 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.929084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56" event={"ID":"62d6bdf9-d27b-4fc7-983f-58dd93cd0763","Type":"ContainerStarted","Data":"bb4b8e0f3b83717cb34a127ac54c224e3f252a0d3ed63e26b7bb5a5fc9018c92"}
Jul 12 16:25:25.930388 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.930364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xjctw" event={"ID":"99ea5434-3f49-441a-a919-83cb02ab36e2","Type":"ContainerStarted","Data":"c3a91b31155af7d2f177110cb66cd6ba8decb0d3c054854365d343493881a4aa"}
Jul 12 16:25:25.931709 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.931687    2577 generic.go:356] "Generic (PLEG): container finished" podID="693d0fabeb3edc2ccb12eab94498fe87" containerID="ea338ba4be4e07fc451d48a7f7458a0ea1b9cdec7d76289458f1ca6099459456" exitCode=0
Jul 12 16:25:25.931798 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.931752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal" event={"ID":"693d0fabeb3edc2ccb12eab94498fe87","Type":"ContainerDied","Data":"ea338ba4be4e07fc451d48a7f7458a0ea1b9cdec7d76289458f1ca6099459456"}
Jul 12 16:25:25.933186 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.933164    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="d0228249faded0f25a2cbd6b0287cb22f529c4ec79744250eca854db5ceb8017" exitCode=0
Jul 12 16:25:25.933286 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.933241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"d0228249faded0f25a2cbd6b0287cb22f529c4ec79744250eca854db5ceb8017"}
Jul 12 16:25:25.934768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.934747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m277f" event={"ID":"c59f85eb-f22c-4e06-8bfb-d7a1a933d084","Type":"ContainerStarted","Data":"0dca453a745fddbf6c0344b9b1edbe56a50480a641b29ef8d4e879738800df83"}
Jul 12 16:25:25.936373 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.936003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n8rnf" event={"ID":"777d7576-e163-42c3-9ce4-cc0995083db5","Type":"ContainerStarted","Data":"842462189ff75c66aa891157a12e74b99bc7e5bd3f7e15a7fcc13d8dcf075ef6"}
Jul 12 16:25:25.938907 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.938887    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:25.939274 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.939256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"6844cc005168827fba560add3a3248ad942eaab0a904ea6d67af5ff51b7d87c2"}
Jul 12 16:25:25.939349 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.939312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"e098634c0595995e22df6af6bf160a1858025ab545c7152772c11b8f1bc84412"}
Jul 12 16:25:25.940769 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.940751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cztp" event={"ID":"89057664-7631-465a-a2cc-a8266aa8ef21","Type":"ContainerStarted","Data":"9f606bd7d6efae594863e9e6ee452e391af5676ece77c155000be8ba9883f0ed"}
Jul 12 16:25:25.945629 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.945510    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xjctw" podStartSLOduration=3.93353672 podStartE2EDuration="23.945491636s" totalImagesPullingTime="20.011954916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:25.944839538 +0000 UTC m=+23.802732926" watchObservedRunningTime="2026-07-12 16:25:25.945491636 +0000 UTC m=+23.803385018"
Jul 12 16:25:25.960366 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.960314    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n8rnf" podStartSLOduration=3.905662425 podStartE2EDuration="23.960292832s" totalImagesPullingTime="20.054630407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:25.959241121 +0000 UTC m=+23.817134510" watchObservedRunningTime="2026-07-12 16:25:25.960292832 +0000 UTC m=+23.818186220"
Jul 12 16:25:25.989953 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:25.989929    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 16:25:26.007225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.007182    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m277f" podStartSLOduration=4.009863058 podStartE2EDuration="24.007166288s" totalImagesPullingTime="19.99730323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:26.006716974 +0000 UTC m=+23.864610360" watchObservedRunningTime="2026-07-12 16:25:26.007166288 +0000 UTC m=+23.865059690"
Jul 12 16:25:26.023004 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.022959    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6cztp" podStartSLOduration=3.989507433 podStartE2EDuration="24.022942748s" totalImagesPullingTime="20.033435315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:26.022602552 +0000 UTC m=+23.880495939" watchObservedRunningTime="2026-07-12 16:25:26.022942748 +0000 UTC m=+23.880836134"
Jul 12 16:25:26.573709 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.573519    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T16:25:25.989947435Z","UUID":"02ddb0a0-66dd-48ed-b701-dde144f11dfb","Handler":null,"Name":"","Endpoint":""}
Jul 12 16:25:26.575348 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.575326    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 16:25:26.575523 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.575370    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 16:25:26.626645 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.626614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:26.627164 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:26.626746    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:26.945779 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.945682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56" event={"ID":"62d6bdf9-d27b-4fc7-983f-58dd93cd0763","Type":"ContainerStarted","Data":"272b60d14d6889ce01948abcc3020bf3acbb2d039ad2b5c58e7f635411ac369d"}
Jul 12 16:25:26.947607 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.947549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal" event={"ID":"693d0fabeb3edc2ccb12eab94498fe87","Type":"ContainerStarted","Data":"9be811551a02ae01a4b35d2174a5c8be1200399194065ff1817e7374fd5f44b5"}
Jul 12 16:25:26.963277 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:26.963222    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-101.ec2.internal" podStartSLOduration=23.96320792 podStartE2EDuration="23.96320792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:26.962516823 +0000 UTC m=+24.820410209" watchObservedRunningTime="2026-07-12 16:25:26.96320792 +0000 UTC m=+24.821101306"
Jul 12 16:25:27.268152 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.268073    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:27.269507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.269471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:27.626285 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.626196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:27.626285 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.626237    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:27.626539 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:27.626317    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:27.626539 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:27.626454    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:27.953759 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.953685    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:27.954288 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.954117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"cf702c324da5f9f20a9ea2094ca4b0416497ebbef83308e9e991915b60472d9e"}
Jul 12 16:25:27.956571 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.956534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56" event={"ID":"62d6bdf9-d27b-4fc7-983f-58dd93cd0763","Type":"ContainerStarted","Data":"9cf02c590b83dd6d6aa306ea35b07aed1f1aa8f6c557147f3b51d31105085ecb"}
Jul 12 16:25:27.978987 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:27.978934    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4qm56" podStartSLOduration=3.865073341 podStartE2EDuration="25.978913116s" totalImagesPullingTime="22.113839775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:27.97829493 +0000 UTC m=+25.836188319" watchObservedRunningTime="2026-07-12 16:25:27.978913116 +0000 UTC m=+25.836806908"
Jul 12 16:25:28.626201 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:28.626161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:28.626459 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:28.626307    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:28.958825 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:28.958751    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 12 16:25:29.626691 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:29.626615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:29.626857 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:29.626615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:29.626857 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:29.626757    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:29.626857 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:29.626810    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:29.964685 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:29.964522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:30.626389 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.626359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:30.626548 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:30.626468    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:30.968990 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.968955    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="48922c6ac53231f610475bc88819929602594e8141807be2aa112ca239cb0868" exitCode=0
Jul 12 16:25:30.969841 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.969045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"48922c6ac53231f610475bc88819929602594e8141807be2aa112ca239cb0868"}
Jul 12 16:25:30.972463 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.972447    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:30.972839 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.972819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"789bf0b4a6b31d11e816fed43f70d4ea9eeb86e9f7f4853d416bf38b6bca615d"}
Jul 12 16:25:30.973043 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.973029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:30.973127 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.973070    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:30.973233 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.973220    2577 scope.go:117] "RemoveContainer" containerID="5f4954ae49941825d63033b0875ee3bf67703d1c7830b37547336618869f540e"
Jul 12 16:25:30.989232 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:30.989212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:31.626185 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.625982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:31.626418 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.626033    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:31.626418 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:31.626280    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:31.626418 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:31.626345    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:31.978401 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.978329    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:25:31.978811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.978666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" event={"ID":"3581a437-1425-4c3d-9645-809ce92c6c0f","Type":"ContainerStarted","Data":"2590db631d3cd06d338d22ef828f7fd6e3795897419c84ea0b700717f8dc2717"}
Jul 12 16:25:31.978855 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.978844    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:31.994523 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:31.994493    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:25:32.007720 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.007674    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97" podStartSLOduration=9.447762881 podStartE2EDuration="30.007659725s" totalImagesPullingTime="20.559896844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:32.007286531 +0000 UTC m=+29.865179920" watchObservedRunningTime="2026-07-12 16:25:32.007659725 +0000 UTC m=+29.865553111"
Jul 12 16:25:32.212502 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.211846    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:32.212502 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.212003    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 12 16:25:32.215040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.213251    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n8rnf"
Jul 12 16:25:32.630644 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.630617    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:32.630824 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:32.630717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:32.982889 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.982850    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="c06d34bacc039c92ed70080b070d7afc89c052ccab731390e4c5b1b2a71cdb56" exitCode=0
Jul 12 16:25:32.983302 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:32.982917    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"c06d34bacc039c92ed70080b070d7afc89c052ccab731390e4c5b1b2a71cdb56"}
Jul 12 16:25:33.130057 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.130022    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ldc5s"]
Jul 12 16:25:33.130231 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.130142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:33.130280 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:33.130223    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:33.133427 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.133390    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c782j"]
Jul 12 16:25:33.133583 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.133538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:33.133688 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:33.133660    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:33.134048 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.134029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxmnn"]
Jul 12 16:25:33.134137 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:33.134111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:33.134207 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:33.134186    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:34.626881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:34.626850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:34.627353 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:34.626850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:34.627353 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:34.627001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:34.627353 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:34.626867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:34.627353 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:34.627106    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:34.627353 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:34.627139    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:34.988967 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:34.988884    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="4c3cb40dec3bee242098d4675a8f9c9605077a5990e3ac2371490297acc25416" exitCode=0
Jul 12 16:25:34.988967 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:34.988931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"4c3cb40dec3bee242098d4675a8f9c9605077a5990e3ac2371490297acc25416"}
Jul 12 16:25:35.261190 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:35.261110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:35.261190 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:35.261145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261264    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261289    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261304    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261312    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b2tpb for pod openshift-network-diagnostics/network-check-target-rxmnn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261338    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs podName:c48b7a86-f3e0-4190-a42e-6cf6533f8a78 nodeName:}" failed. No retries permitted until 2026-07-12 16:26:07.26131938 +0000 UTC m=+65.119212748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs") pod "network-metrics-daemon-c782j" (UID: "c48b7a86-f3e0-4190-a42e-6cf6533f8a78") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 16:25:35.261380 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.261354    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb podName:0ddd2226-2294-4921-bb87-8487685b86be nodeName:}" failed. No retries permitted until 2026-07-12 16:26:07.261346563 +0000 UTC m=+65.119239928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2tpb" (UniqueName: "kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb") pod "network-check-target-rxmnn" (UID: "0ddd2226-2294-4921-bb87-8487685b86be") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 16:25:35.361988 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:35.361954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:35.362148 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.362101    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:35.362188 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:35.362164    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret podName:e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa nodeName:}" failed. No retries permitted until 2026-07-12 16:26:07.36214958 +0000 UTC m=+65.220042945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret") pod "global-pull-secret-syncer-ldc5s" (UID: "e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa") : object "kube-system"/"original-pull-secret" not registered
Jul 12 16:25:36.626648 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:36.626435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:36.627169 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:36.626435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:36.627169 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:36.626738    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldc5s" podUID="e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa"
Jul 12 16:25:36.627169 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:36.626435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:36.627169 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:36.626801    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c782j" podUID="c48b7a86-f3e0-4190-a42e-6cf6533f8a78"
Jul 12 16:25:36.627169 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:25:36.626978    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxmnn" podUID="0ddd2226-2294-4921-bb87-8487685b86be"
Jul 12 16:25:37.931813 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.931786    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-101.ec2.internal" event="NodeReady"
Jul 12 16:25:37.932227 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.931930    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 16:25:37.967863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.967622    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-577c6dfbcb-46b5c"]
Jul 12 16:25:37.990794 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.990762    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qx4vz"]
Jul 12 16:25:37.990960 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.990891    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:37.994163 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.994139    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 16:25:37.994304 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.994239    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 16:25:37.994404 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.994373    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pw8wq\""
Jul 12 16:25:37.994404 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.994376    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 16:25:37.999574 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:37.999554    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 16:25:38.002472 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.002449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-577c6dfbcb-46b5c"]
Jul 12 16:25:38.002588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.002509    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xprwl"]
Jul 12 16:25:38.002588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.002573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.005692 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.005672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-trdc7\""
Jul 12 16:25:38.006002 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.005988    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 16:25:38.006098 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.006004    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 16:25:38.016393 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.016341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx4vz"]
Jul 12 16:25:38.016393 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.016374    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gxhh5"]
Jul 12 16:25:38.016514 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.016469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.019410 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.019392    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 16:25:38.019529 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.019413    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 16:25:38.019529 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.019438    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 16:25:38.019760 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.019746    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b5bf5\""
Jul 12 16:25:38.034708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.034681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xprwl"]
Jul 12 16:25:38.034811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.034722    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxhh5"]
Jul 12 16:25:38.034811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.034767    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.037502 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.037460    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p9km6\""
Jul 12 16:25:38.037502 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.037464    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 16:25:38.037909 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.037892    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 16:25:38.037989 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.037896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 16:25:38.038065 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.037896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 16:25:38.085161 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-ca-trust-extracted\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085161 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-bound-sa-token\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-trusted-ca\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-installation-pull-secrets\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbf5dd38-a805-485a-9d47-a800b4e31f7a-tmp-dir\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-image-registry-private-configuration\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-certificates\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52cbl\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-kube-api-access-52cbl\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.085383 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbf5dd38-a805-485a-9d47-a800b4e31f7a-metrics-tls\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.085700 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgfk\" (UniqueName: \"kubernetes.io/projected/cbf5dd38-a805-485a-9d47-a800b4e31f7a-kube-api-access-gcgfk\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.085700 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbf5dd38-a805-485a-9d47-a800b4e31f7a-config-volume\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.085700 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.085471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-tls\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.186493 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-image-registry-private-configuration\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-certificates\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52cbl\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-kube-api-access-52cbl\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbf5dd38-a805-485a-9d47-a800b4e31f7a-metrics-tls\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgfk\" (UniqueName: \"kubernetes.io/projected/cbf5dd38-a805-485a-9d47-a800b4e31f7a-kube-api-access-gcgfk\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbf5dd38-a805-485a-9d47-a800b4e31f7a-config-volume\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-tls\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.186672 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhmr\" (UniqueName: \"kubernetes.io/projected/7d09975a-2371-43bd-b98b-8be88553b701-kube-api-access-fqhmr\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d09975a-2371-43bd-b98b-8be88553b701-crio-socket\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d09975a-2371-43bd-b98b-8be88553b701-data-volume\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d09975a-2371-43bd-b98b-8be88553b701-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d09975a-2371-43bd-b98b-8be88553b701-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-ca-trust-extracted\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-bound-sa-token\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1efdd617-8b97-489f-9a4f-7798b6b597f0-cert\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-trusted-ca\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-installation-pull-secrets\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.187003 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.186990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbf5dd38-a805-485a-9d47-a800b4e31f7a-tmp-dir\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.187461 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.187016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfkh8\" (UniqueName: \"kubernetes.io/projected/1efdd617-8b97-489f-9a4f-7798b6b597f0-kube-api-access-zfkh8\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.187461 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.187434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-certificates\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.187768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.187715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-ca-trust-extracted\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.188134 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.187955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cbf5dd38-a805-485a-9d47-a800b4e31f7a-config-volume\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.188134 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.187975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbf5dd38-a805-485a-9d47-a800b4e31f7a-tmp-dir\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.188312 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.188290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-trusted-ca\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.191461 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.191439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-installation-pull-secrets\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.191576 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.191462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-image-registry-private-configuration\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.191576 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.191445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbf5dd38-a805-485a-9d47-a800b4e31f7a-metrics-tls\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.191576 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.191504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-registry-tls\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.218297 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.218269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgfk\" (UniqueName: \"kubernetes.io/projected/cbf5dd38-a805-485a-9d47-a800b4e31f7a-kube-api-access-gcgfk\") pod \"dns-default-qx4vz\" (UID: \"cbf5dd38-a805-485a-9d47-a800b4e31f7a\") " pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.220191 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.220155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-bound-sa-token\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.221779 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.221754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52cbl\" (UniqueName: \"kubernetes.io/projected/5bbb2221-94ee-40b0-8280-6d7b3e52e2ba-kube-api-access-52cbl\") pod \"image-registry-577c6dfbcb-46b5c\" (UID: \"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba\") " pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.288280 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1efdd617-8b97-489f-9a4f-7798b6b597f0-cert\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.288280 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfkh8\" (UniqueName: \"kubernetes.io/projected/1efdd617-8b97-489f-9a4f-7798b6b597f0-kube-api-access-zfkh8\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.288530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhmr\" (UniqueName: \"kubernetes.io/projected/7d09975a-2371-43bd-b98b-8be88553b701-kube-api-access-fqhmr\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d09975a-2371-43bd-b98b-8be88553b701-crio-socket\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d09975a-2371-43bd-b98b-8be88553b701-data-volume\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d09975a-2371-43bd-b98b-8be88553b701-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d09975a-2371-43bd-b98b-8be88553b701-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d09975a-2371-43bd-b98b-8be88553b701-crio-socket\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.288945 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.288920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d09975a-2371-43bd-b98b-8be88553b701-data-volume\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.289262 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.289232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d09975a-2371-43bd-b98b-8be88553b701-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.290933 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.290909    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d09975a-2371-43bd-b98b-8be88553b701-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.291034 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.290919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1efdd617-8b97-489f-9a4f-7798b6b597f0-cert\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.303023 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.302996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:38.303381 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.303363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfkh8\" (UniqueName: \"kubernetes.io/projected/1efdd617-8b97-489f-9a4f-7798b6b597f0-kube-api-access-zfkh8\") pod \"ingress-canary-xprwl\" (UID: \"1efdd617-8b97-489f-9a4f-7798b6b597f0\") " pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.306051 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.306027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhmr\" (UniqueName: \"kubernetes.io/projected/7d09975a-2371-43bd-b98b-8be88553b701-kube-api-access-fqhmr\") pod \"insights-runtime-extractor-gxhh5\" (UID: \"7d09975a-2371-43bd-b98b-8be88553b701\") " pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.314084 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.314057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:38.327209 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.327188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xprwl"
Jul 12 16:25:38.344486 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.344447    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gxhh5"
Jul 12 16:25:38.626106 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.626073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:25:38.626295 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.626076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:25:38.626295 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.626083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:25:38.630696 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.630667    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xb45\""
Jul 12 16:25:38.631002 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.630979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kpl6g\""
Jul 12 16:25:38.631129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.631016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 16:25:38.631129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.631070    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 16:25:38.631129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.631016    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 16:25:38.631328 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:38.631301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 16:25:39.262837 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:39.262805    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xprwl"]
Jul 12 16:25:39.266469 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:39.266449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gxhh5"]
Jul 12 16:25:39.272217 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:39.272196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-577c6dfbcb-46b5c"]
Jul 12 16:25:39.274861 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:39.274841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx4vz"]
Jul 12 16:25:39.327090 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:39.327038    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d09975a_2371_43bd_b98b_8be88553b701.slice/crio-661ed724126c2e31f98d3784a679e6ae9ea45eeee148270b43de438d3592f8de WatchSource:0}: Error finding container 661ed724126c2e31f98d3784a679e6ae9ea45eeee148270b43de438d3592f8de: Status 404 returned error can't find the container with id 661ed724126c2e31f98d3784a679e6ae9ea45eeee148270b43de438d3592f8de
Jul 12 16:25:39.327341 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:39.327317    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efdd617_8b97_489f_9a4f_7798b6b597f0.slice/crio-551854c0ed51ae1807f9bb77e687d9e9c56c792891b1eb7af555ad5016d206dc WatchSource:0}: Error finding container 551854c0ed51ae1807f9bb77e687d9e9c56c792891b1eb7af555ad5016d206dc: Status 404 returned error can't find the container with id 551854c0ed51ae1807f9bb77e687d9e9c56c792891b1eb7af555ad5016d206dc
Jul 12 16:25:39.328614 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:39.328590    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bbb2221_94ee_40b0_8280_6d7b3e52e2ba.slice/crio-1a69d55247b358a36b0e22d330a3dd8e81c3eaf52c49b01df91fe976fc89e484 WatchSource:0}: Error finding container 1a69d55247b358a36b0e22d330a3dd8e81c3eaf52c49b01df91fe976fc89e484: Status 404 returned error can't find the container with id 1a69d55247b358a36b0e22d330a3dd8e81c3eaf52c49b01df91fe976fc89e484
Jul 12 16:25:39.330987 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:25:39.330814    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf5dd38_a805_485a_9d47_a800b4e31f7a.slice/crio-03f47fe2a57f62fe159ff366aac22c055ba0ebec29bf1ead2f44a33b566ed2ff WatchSource:0}: Error finding container 03f47fe2a57f62fe159ff366aac22c055ba0ebec29bf1ead2f44a33b566ed2ff: Status 404 returned error can't find the container with id 03f47fe2a57f62fe159ff366aac22c055ba0ebec29bf1ead2f44a33b566ed2ff
Jul 12 16:25:40.003934 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.003706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx4vz" event={"ID":"cbf5dd38-a805-485a-9d47-a800b4e31f7a","Type":"ContainerStarted","Data":"03f47fe2a57f62fe159ff366aac22c055ba0ebec29bf1ead2f44a33b566ed2ff"}
Jul 12 16:25:40.005152 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.005093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xprwl" event={"ID":"1efdd617-8b97-489f-9a4f-7798b6b597f0","Type":"ContainerStarted","Data":"551854c0ed51ae1807f9bb77e687d9e9c56c792891b1eb7af555ad5016d206dc"}
Jul 12 16:25:40.007430 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.007398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c" event={"ID":"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba","Type":"ContainerStarted","Data":"5cc43626d903b1c01960d3c929fd53944ff8b9a230395ea259770029a4516b2d"}
Jul 12 16:25:40.007562 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.007453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c" event={"ID":"5bbb2221-94ee-40b0-8280-6d7b3e52e2ba","Type":"ContainerStarted","Data":"1a69d55247b358a36b0e22d330a3dd8e81c3eaf52c49b01df91fe976fc89e484"}
Jul 12 16:25:40.007770 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.007715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:25:40.009105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.009080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxhh5" event={"ID":"7d09975a-2371-43bd-b98b-8be88553b701","Type":"ContainerStarted","Data":"661ed724126c2e31f98d3784a679e6ae9ea45eeee148270b43de438d3592f8de"}
Jul 12 16:25:40.016154 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.015511    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="86b9cc1a24bee431102108c16e3278abe142f7ea66fa97b2e176bfb072a737d5" exitCode=0
Jul 12 16:25:40.016154 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.015555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"86b9cc1a24bee431102108c16e3278abe142f7ea66fa97b2e176bfb072a737d5"}
Jul 12 16:25:40.029264 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:40.029209    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c" podStartSLOduration=9.029189457 podStartE2EDuration="9.029189457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:40.027143273 +0000 UTC m=+37.885036661" watchObservedRunningTime="2026-07-12 16:25:40.029189457 +0000 UTC m=+37.887082824"
Jul 12 16:25:41.026366 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:41.026322    2577 generic.go:356] "Generic (PLEG): container finished" podID="24d22bcd-295e-4ff5-a7bd-9e874e60e8c0" containerID="c952c55313243732c90963c6c219cfd63da965cb6647711c20c086dd91a8fd1c" exitCode=0
Jul 12 16:25:41.026821 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:41.026490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerDied","Data":"c952c55313243732c90963c6c219cfd63da965cb6647711c20c086dd91a8fd1c"}
Jul 12 16:25:42.034217 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:42.033955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7glcg" event={"ID":"24d22bcd-295e-4ff5-a7bd-9e874e60e8c0","Type":"ContainerStarted","Data":"758b893145bfbbb74a5eb97059c709b9e25f7a39604e2ddba2481241e85d636f"}
Jul 12 16:25:42.056690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:42.056634    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7glcg" podStartSLOduration=9.323892758 podStartE2EDuration="40.056612075s" totalImagesPullingTime="30.732719317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:42.055360258 +0000 UTC m=+39.913253655" watchObservedRunningTime="2026-07-12 16:25:42.056612075 +0000 UTC m=+39.914505463"
Jul 12 16:25:46.046778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.046744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx4vz" event={"ID":"cbf5dd38-a805-485a-9d47-a800b4e31f7a","Type":"ContainerStarted","Data":"1d86697432e06666f18a3d4a554769a75db0e60273ad613fbf667f9b01efb53e"}
Jul 12 16:25:46.047223 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.046813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx4vz" event={"ID":"cbf5dd38-a805-485a-9d47-a800b4e31f7a","Type":"ContainerStarted","Data":"8b88679c36df4ed204f4b4c27aa1cd1d4d0630367158be6399bedeca8ad88f2d"}
Jul 12 16:25:46.047223 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.046846    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:46.048287 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.048257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xprwl" event={"ID":"1efdd617-8b97-489f-9a4f-7798b6b597f0","Type":"ContainerStarted","Data":"bf8fbea112363b87b8f1fec8cab8852b0cc6e449d70acbebfe8f4c44250585ce"}
Jul 12 16:25:46.049852 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.049830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxhh5" event={"ID":"7d09975a-2371-43bd-b98b-8be88553b701","Type":"ContainerStarted","Data":"a3de212369fd29c34c1a307406383a2a18d26eaf3a8583e94aab980667401c46"}
Jul 12 16:25:46.063731 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.063692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qx4vz" podStartSLOduration=2.7873291460000003 podStartE2EDuration="9.063676673s" totalImagesPullingTime="6.276347527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:46.063338992 +0000 UTC m=+43.921232380" watchObservedRunningTime="2026-07-12 16:25:46.063676673 +0000 UTC m=+43.921570060"
Jul 12 16:25:46.078791 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:46.078742    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xprwl" podStartSLOduration=2.794626251 podStartE2EDuration="9.078725974s" totalImagesPullingTime="6.284099723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:46.0779354 +0000 UTC m=+43.935828787" watchObservedRunningTime="2026-07-12 16:25:46.078725974 +0000 UTC m=+43.936619360"
Jul 12 16:25:48.058925 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:48.058885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxhh5" event={"ID":"7d09975a-2371-43bd-b98b-8be88553b701","Type":"ContainerStarted","Data":"a56354ed57e807bbccfcb2d98744c52deae41cef1304974923f36162754b89bf"}
Jul 12 16:25:51.070171 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:51.070131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gxhh5" event={"ID":"7d09975a-2371-43bd-b98b-8be88553b701","Type":"ContainerStarted","Data":"26cf2bed24b22b9c5d3b1e2d09982794fd74d5fab0846e79fad195df2997675b"}
Jul 12 16:25:51.092582 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:51.092510    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gxhh5" podStartSLOduration=3.471988936 podStartE2EDuration="14.092492914s" totalImagesPullingTime="10.620503978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:25:51.091830799 +0000 UTC m=+48.949724186" watchObservedRunningTime="2026-07-12 16:25:51.092492914 +0000 UTC m=+48.950386297"
Jul 12 16:25:56.055184 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:56.055151    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qx4vz"
Jul 12 16:25:58.307238 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:58.307200    2577 patch_prober.go:28] interesting pod/image-registry-577c6dfbcb-46b5c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 12 16:25:58.307694 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:25:58.307264    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c" podUID="5bbb2221-94ee-40b0-8280-6d7b3e52e2ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 16:26:00.308212 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.308175    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"]
Jul 12 16:26:00.339631 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.339599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"]
Jul 12 16:26:00.339778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.339723    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.343259 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.343236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 12 16:26:00.343388 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.343244    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 12 16:26:00.344811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.344791    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 16:26:00.344961 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.344943    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 16:26:00.345025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.344987    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pmmml\""
Jul 12 16:26:00.345081 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.344988    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 16:26:00.345134 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.344946    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 12 16:26:00.386076 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.386046    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cv2mr"]
Jul 12 16:26:00.406488 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.406458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.408869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.408847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 16:26:00.409089 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.409074    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-frj9r\""
Jul 12 16:26:00.409257 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.409240    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 16:26:00.410040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.410021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 16:26:00.451665 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.451665 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-wtmp\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451710    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqlxj\" (UniqueName: \"kubernetes.io/projected/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-kube-api-access-wqlxj\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-sys\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-root\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.451879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-metrics-client-ca\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.452211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.452211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.452211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.451973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrdr\" (UniqueName: \"kubernetes.io/projected/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-api-access-zzrdr\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.452211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.452048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-textfile\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.452211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.452093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553060 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553060 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqlxj\" (UniqueName: \"kubernetes.io/projected/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-kube-api-access-wqlxj\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-sys\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-root\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-metrics-client-ca\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:00.553381    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-root\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrdr\" (UniqueName: \"kubernetes.io/projected/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-api-access-zzrdr\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:00.553454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls podName:3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83 nodeName:}" failed. No retries permitted until 2026-07-12 16:26:01.053434153 +0000 UTC m=+58.911327521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kgc6s" (UID: "3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83") : secret "kube-state-metrics-tls" not found
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553540    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-textfile\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.553588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:00.553546    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-wtmp\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:00.553670    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls podName:ad58a8ba-479c-4ee3-902e-b3ec6c2026f4 nodeName:}" failed. No retries permitted until 2026-07-12 16:26:01.053653624 +0000 UTC m=+58.911547010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls") pod "node-exporter-cv2mr" (UID: "ad58a8ba-479c-4ee3-902e-b3ec6c2026f4") : secret "node-exporter-tls" not found
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-sys\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-wtmp\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-metrics-client-ca\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554070 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.553934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-textfile\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.554549 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.554387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.557378 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.557344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.557505 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.557423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:00.561996 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.561927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqlxj\" (UniqueName: \"kubernetes.io/projected/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-kube-api-access-wqlxj\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:00.562947 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:00.562902    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrdr\" (UniqueName: \"kubernetes.io/projected/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-api-access-zzrdr\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:01.031105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.031074    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-577c6dfbcb-46b5c"
Jul 12 16:26:01.059668 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.059634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:01.059849 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.059681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:01.061982 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.061951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad58a8ba-479c-4ee3-902e-b3ec6c2026f4-node-exporter-tls\") pod \"node-exporter-cv2mr\" (UID: \"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4\") " pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:01.062094 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.062033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kgc6s\" (UID: \"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:01.248534 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.248495    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"
Jul 12 16:26:01.315608 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.315395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cv2mr"
Jul 12 16:26:01.324818 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:01.324787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad58a8ba_479c_4ee3_902e_b3ec6c2026f4.slice/crio-05397c94eb4fb5a8df7ae376bae3da5f3d2fc987f03eb12c5934fcc74900ce9b WatchSource:0}: Error finding container 05397c94eb4fb5a8df7ae376bae3da5f3d2fc987f03eb12c5934fcc74900ce9b: Status 404 returned error can't find the container with id 05397c94eb4fb5a8df7ae376bae3da5f3d2fc987f03eb12c5934fcc74900ce9b
Jul 12 16:26:01.404120 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.404089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kgc6s"]
Jul 12 16:26:01.407451 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:01.407426    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e84b7d4_cab8_4fc0_9bc0_1dfd6e915b83.slice/crio-263717c941d866ac671f018f62c624214db9fbd733a322421ecfcd5ee9a486c9 WatchSource:0}: Error finding container 263717c941d866ac671f018f62c624214db9fbd733a322421ecfcd5ee9a486c9: Status 404 returned error can't find the container with id 263717c941d866ac671f018f62c624214db9fbd733a322421ecfcd5ee9a486c9
Jul 12 16:26:01.668846 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.668812    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 16:26:01.672051 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.672030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.674725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.674661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 12 16:26:01.674725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.674703    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 12 16:26:01.675010 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.674994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 12 16:26:01.675073 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675024    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 12 16:26:01.675323 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675304    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 12 16:26:01.675380 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675324    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 12 16:26:01.675765 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675743    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 12 16:26:01.675926 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 12 16:26:01.676000 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.675931    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6qrrj\""
Jul 12 16:26:01.676071 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.676054    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 12 16:26:01.700705 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.700671    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 16:26:01.766754 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.766723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwd89\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-kube-api-access-vwd89\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.766754 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.766758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.766994 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.766792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.766994 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.766945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.766988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-web-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767171 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767171 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767261 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-out\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767261 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.767347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.767323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868004 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.867966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868175 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwd89\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-kube-api-access-vwd89\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868175 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868175 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868175 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868175 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-web-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-out\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.868397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.869102 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.868871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.869102 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:01.868983    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 12 16:26:01.869102 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:26:01.869057    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls podName:e9254ddc-d440-4bf7-b7da-b3f7bd94af5e nodeName:}" failed. No retries permitted until 2026-07-12 16:26:02.369038067 +0000 UTC m=+60.226931437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e9254ddc-d440-4bf7-b7da-b3f7bd94af5e") : secret "alertmanager-main-tls" not found
Jul 12 16:26:01.869514 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.869376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.869514 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.869503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.872510 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.872408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.873069 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.872818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.873340 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.873311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-web-config\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.873517 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.873496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.873804 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.873773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.873978 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.873934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.874079 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.874033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.874552 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.874530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-config-out\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:01.877789 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:01.877772    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwd89\" (UniqueName: \"kubernetes.io/projected/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-kube-api-access-vwd89\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:02.108949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.108893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s" event={"ID":"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83","Type":"ContainerStarted","Data":"263717c941d866ac671f018f62c624214db9fbd733a322421ecfcd5ee9a486c9"}
Jul 12 16:26:02.110382 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.110348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cv2mr" event={"ID":"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4","Type":"ContainerStarted","Data":"05397c94eb4fb5a8df7ae376bae3da5f3d2fc987f03eb12c5934fcc74900ce9b"}
Jul 12 16:26:02.373960 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.373851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:02.376706 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.376677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9254ddc-d440-4bf7-b7da-b3f7bd94af5e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:02.585814 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.585759    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6qrrj\""
Jul 12 16:26:02.593169 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.593141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 12 16:26:02.779072 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:02.778917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 12 16:26:02.781805 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:02.781772    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9254ddc_d440_4bf7_b7da_b3f7bd94af5e.slice/crio-092f3f6ededffb97d76ca7c8a41778002aa25b86da1c51cd46d56c449381af38 WatchSource:0}: Error finding container 092f3f6ededffb97d76ca7c8a41778002aa25b86da1c51cd46d56c449381af38: Status 404 returned error can't find the container with id 092f3f6ededffb97d76ca7c8a41778002aa25b86da1c51cd46d56c449381af38
Jul 12 16:26:03.115413 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.115375    2577 generic.go:356] "Generic (PLEG): container finished" podID="ad58a8ba-479c-4ee3-902e-b3ec6c2026f4" containerID="e84e4c8c797420c21d7753cb92fb8148c697374464682488731d5338d15c27de" exitCode=0
Jul 12 16:26:03.115598 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.115469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cv2mr" event={"ID":"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4","Type":"ContainerDied","Data":"e84e4c8c797420c21d7753cb92fb8148c697374464682488731d5338d15c27de"}
Jul 12 16:26:03.116822 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.116784    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"092f3f6ededffb97d76ca7c8a41778002aa25b86da1c51cd46d56c449381af38"}
Jul 12 16:26:03.118840 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.118811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s" event={"ID":"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83","Type":"ContainerStarted","Data":"895daff3bf76982885e55a6e1e80e0aab9a27088f6f40b74c0fcd1231dfd097f"}
Jul 12 16:26:03.118945 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.118867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s" event={"ID":"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83","Type":"ContainerStarted","Data":"e529c83d01d14184962e30804296513afcd1585f43c3ff38e463feb24fa44ba3"}
Jul 12 16:26:03.118945 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.118890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s" event={"ID":"3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83","Type":"ContainerStarted","Data":"6b5de7d6b7e559e32c529ddcc4733d229f3638a70155ac8c9421de23d7072009"}
Jul 12 16:26:03.179112 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.179062    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-kgc6s" podStartSLOduration=2.092672896 podStartE2EDuration="3.179038959s" totalImagesPullingTime="1.086366063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:03.17715086 +0000 UTC m=+61.035044251" watchObservedRunningTime="2026-07-12 16:26:03.179038959 +0000 UTC m=+61.036932347"
Jul 12 16:26:03.519379 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.519288    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64b8fd548-8fb56"]
Jul 12 16:26:03.522127 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.522101    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.526380 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.526357    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 12 16:26:03.526528 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.526471    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4c7sfrkj6or79\""
Jul 12 16:26:03.527713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.527690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 12 16:26:03.527891 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.527692    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 12 16:26:03.527891 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.527828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 12 16:26:03.528015 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.527895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6sdcr\""
Jul 12 16:26:03.528228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.528206    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 12 16:26:03.543495 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.543455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64b8fd548-8fb56"]
Jul 12 16:26:03.584572 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584534    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584765 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584765 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-metrics-client-ca\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584765 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584905 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xvdj\" (UniqueName: \"kubernetes.io/projected/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-kube-api-access-9xvdj\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584905 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584905 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.584905 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.584901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-grpc-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685732 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685732 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685968 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-metrics-client-ca\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685968 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685968 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xvdj\" (UniqueName: \"kubernetes.io/projected/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-kube-api-access-9xvdj\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.685968 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.686205 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.685966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.686205 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.686055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-grpc-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.686874 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.686811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-metrics-client-ca\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.688946 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.688516    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.688946 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.688830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.689054 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.688978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.689054 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.689021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-grpc-tls\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.689157 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.689075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.689157 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.689142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.695011 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.694944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xvdj\" (UniqueName: \"kubernetes.io/projected/f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1-kube-api-access-9xvdj\") pod \"thanos-querier-64b8fd548-8fb56\" (UID: \"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1\") " pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.832877 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.832839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:03.971600 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.971572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64b8fd548-8fb56"]
Jul 12 16:26:03.976416 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:03.976387    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91ccd9a_1f92_4fb8_9dcc_b5cb701408d1.slice/crio-af6826e70723d5de1240b2d59aacf480c9a45c2e43ef0dbc1b9be1b718657ee4 WatchSource:0}: Error finding container af6826e70723d5de1240b2d59aacf480c9a45c2e43ef0dbc1b9be1b718657ee4: Status 404 returned error can't find the container with id af6826e70723d5de1240b2d59aacf480c9a45c2e43ef0dbc1b9be1b718657ee4
Jul 12 16:26:03.995724 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:03.995702    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jrr97"
Jul 12 16:26:04.123329 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.123293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"af6826e70723d5de1240b2d59aacf480c9a45c2e43ef0dbc1b9be1b718657ee4"}
Jul 12 16:26:04.129602 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.129568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cv2mr" event={"ID":"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4","Type":"ContainerStarted","Data":"4a8b4eb5304568abd3441f2e6b07148675a5dc6082b008c95c517263215ced11"}
Jul 12 16:26:04.129787 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.129651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cv2mr" event={"ID":"ad58a8ba-479c-4ee3-902e-b3ec6c2026f4","Type":"ContainerStarted","Data":"22df79003c4957c74024d4e45bd693c8baeca37b16807ccf5e8b33e1e3511ff6"}
Jul 12 16:26:04.130974 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.130948    2577 generic.go:356] "Generic (PLEG): container finished" podID="e9254ddc-d440-4bf7-b7da-b3f7bd94af5e" containerID="65d772bf2bcb83e8b7f65e86747d835c854cca9217ebb3d0341440be4a945d91" exitCode=0
Jul 12 16:26:04.131052 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.131031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerDied","Data":"65d772bf2bcb83e8b7f65e86747d835c854cca9217ebb3d0341440be4a945d91"}
Jul 12 16:26:04.171944 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:04.171887    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cv2mr" podStartSLOduration=2.912414465 podStartE2EDuration="4.171869348s" totalImagesPullingTime="1.166966522s" totalInitContainerRuntime="92.488361ms" isStatefulPod=true podCreationTimestamp="2026-07-12 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:04.170976921 +0000 UTC m=+62.028870308" watchObservedRunningTime="2026-07-12 16:26:04.171869348 +0000 UTC m=+62.029762734"
Jul 12 16:26:06.142488 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.142408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"01d6813819689cc6831cf26857877ffd280784ed8ab78dc0fdbb802f846db1fd"}
Jul 12 16:26:06.142857 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.142527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"9c0e089226ff683b66752e6141fdd8e359445fb3b6683bb8ac44b42e676cd859"}
Jul 12 16:26:06.142857 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.142571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"f27400923f9a8b7b50c4b9d9a493cecd2568da5e4f58a21159b05c6286d0b4bd"}
Jul 12 16:26:06.144931 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.144902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"68d268bb78218e20a1b60d281ac058ea75714a305f14c80eb1b9cadedb76de01"}
Jul 12 16:26:06.145088 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.144963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"4e6de461bd8173970f1f614c3c3b640c0bed5e8336c906b5fec88db2bbbbb909"}
Jul 12 16:26:06.145088 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.144998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"ee4014c986d96a952e2eb8afca13322019f7b3a1f9e870b39d7039f3f30bd305"}
Jul 12 16:26:06.815127 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.815095    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 16:26:06.819771 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.819747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.823667 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823622    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 12 16:26:06.823667 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823641    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 12 16:26:06.823881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823705    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 12 16:26:06.823881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823718    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 12 16:26:06.823881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823752    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dgdrb\""
Jul 12 16:26:06.823881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 12 16:26:06.824112 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823892    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 12 16:26:06.824112 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823936    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 16:26:06.824112 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.823946    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 12 16:26:06.824297 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824204    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 12 16:26:06.824297 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824292    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 12 16:26:06.824507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 12 16:26:06.824507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824351    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 12 16:26:06.824507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824381    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 12 16:26:06.824507 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824289    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 12 16:26:06.824764 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.824645    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9u9uksar1d6ja\""
Jul 12 16:26:06.826512 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.826472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 12 16:26:06.837442 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.837414    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 16:26:06.917183 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917183 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917392 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917392 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917392 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917328    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917392 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-web-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-config-out\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7sj9\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-kube-api-access-t7sj9\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:06.917797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:06.917756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018171 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-config-out\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018275 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7sj9\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-kube-api-access-t7sj9\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018559 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018559 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018674 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018674 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018674 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018674 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.018860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.018954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-web-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019100 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.019077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.019304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.019748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.019991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.019862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.020192 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.020065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.021120 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.021100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.022876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.021811    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c87f7954-ca37-48c9-9a2d-37b388c91665-config-out\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.022876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.022059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.022876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.022084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-web-config\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.022876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.022517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.023250 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.023173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.024294 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.024026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.024294 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.024245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.024967 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.024923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.025495 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.025143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.025608 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.025463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.025789 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.025764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.025991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.025972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c87f7954-ca37-48c9-9a2d-37b388c91665-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.027041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.027020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c87f7954-ca37-48c9-9a2d-37b388c91665-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.027537 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.027505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7sj9\" (UniqueName: \"kubernetes.io/projected/c87f7954-ca37-48c9-9a2d-37b388c91665-kube-api-access-t7sj9\") pod \"prometheus-k8s-0\" (UID: \"c87f7954-ca37-48c9-9a2d-37b388c91665\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.131305 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.131269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:07.152441 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.152409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"3491f77d2413b0dd5dae97f009280e68f59e9c013d79813f710ad07579ba4964"}
Jul 12 16:26:07.152790 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.152543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"0586675c84a226e39f680b8bcea18dc0dbba3bd3fe09066dbe70d7ecf1fd1218"}
Jul 12 16:26:07.152790 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.152588    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9254ddc-d440-4bf7-b7da-b3f7bd94af5e","Type":"ContainerStarted","Data":"df415c7183b20c3f7e7a1154549bd2370ff6f8a48b6c0d40bde29fc54da5cabd"}
Jul 12 16:26:07.157351 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.157321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"c6cad3c278d6a30df9d92626ca6c415727a753151b258d6c9e18a31ed1c65ba4"}
Jul 12 16:26:07.157453 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.157385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"aaf9848942238c8c99d7a33a87c46b98f88f86e0ffd449b91fc382f7e09ea5fd"}
Jul 12 16:26:07.185046 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.183058    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.713760361 podStartE2EDuration="6.183034307s" totalImagesPullingTime="3.452118925s" totalInitContainerRuntime="17.155021ms" isStatefulPod=false podCreationTimestamp="2026-07-12 16:26:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:07.180098018 +0000 UTC m=+65.037991405" watchObservedRunningTime="2026-07-12 16:26:07.183034307 +0000 UTC m=+65.040927695"
Jul 12 16:26:07.284708 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.284673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 16:26:07.288578 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:07.288549    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87f7954_ca37_48c9_9a2d_37b388c91665.slice/crio-184d01f5edaba2494bb090292b97c50b732c1569f399ed7aad35bedde05a45cf WatchSource:0}: Error finding container 184d01f5edaba2494bb090292b97c50b732c1569f399ed7aad35bedde05a45cf: Status 404 returned error can't find the container with id 184d01f5edaba2494bb090292b97c50b732c1569f399ed7aad35bedde05a45cf
Jul 12 16:26:07.321541 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.321517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:26:07.321663 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.321547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:26:07.324397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.324358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 16:26:07.324589 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.324577    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 16:26:07.334346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.334324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c48b7a86-f3e0-4190-a42e-6cf6533f8a78-metrics-certs\") pod \"network-metrics-daemon-c782j\" (UID: \"c48b7a86-f3e0-4190-a42e-6cf6533f8a78\") " pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:26:07.334466 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.334412    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 16:26:07.344632 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.344605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2tpb\" (UniqueName: \"kubernetes.io/projected/0ddd2226-2294-4921-bb87-8487685b86be-kube-api-access-b2tpb\") pod \"network-check-target-rxmnn\" (UID: \"0ddd2226-2294-4921-bb87-8487685b86be\") " pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:26:07.422155 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.422117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:26:07.424709 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.424692    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 16:26:07.434764 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.434739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa-original-pull-secret\") pod \"global-pull-secret-syncer-ldc5s\" (UID: \"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa\") " pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:26:07.442006 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.441989    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kpl6g\""
Jul 12 16:26:07.446023 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.446006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldc5s"
Jul 12 16:26:07.450768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.450751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:26:07.454054 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.454034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xb45\""
Jul 12 16:26:07.463037 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.463015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c782j"
Jul 12 16:26:07.611640 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.611573    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ldc5s"]
Jul 12 16:26:07.612191 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:07.612166    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e96b4c_e36a_4a5c_afb5_5f64e1384ffa.slice/crio-db13bf40aa3f6c4a375b34796f5157dfe89d34c657b1b634632ceddb38fc7896 WatchSource:0}: Error finding container db13bf40aa3f6c4a375b34796f5157dfe89d34c657b1b634632ceddb38fc7896: Status 404 returned error can't find the container with id db13bf40aa3f6c4a375b34796f5157dfe89d34c657b1b634632ceddb38fc7896
Jul 12 16:26:07.625524 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.625501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxmnn"]
Jul 12 16:26:07.629150 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:07.629121    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddd2226_2294_4921_bb87_8487685b86be.slice/crio-9ac7f12ebee685d9f8c7eaaf945b9a3089464253d39a835300aadd5a7125b95f WatchSource:0}: Error finding container 9ac7f12ebee685d9f8c7eaaf945b9a3089464253d39a835300aadd5a7125b95f: Status 404 returned error can't find the container with id 9ac7f12ebee685d9f8c7eaaf945b9a3089464253d39a835300aadd5a7125b95f
Jul 12 16:26:07.641227 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:07.641203    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c782j"]
Jul 12 16:26:07.644160 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:26:07.644138    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48b7a86_f3e0_4190_a42e_6cf6533f8a78.slice/crio-2ec4cffa9f92e2fc5d6248305b8ddf57ab093d21d46cb860c72a624ba672807a WatchSource:0}: Error finding container 2ec4cffa9f92e2fc5d6248305b8ddf57ab093d21d46cb860c72a624ba672807a: Status 404 returned error can't find the container with id 2ec4cffa9f92e2fc5d6248305b8ddf57ab093d21d46cb860c72a624ba672807a
Jul 12 16:26:08.166931 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.166890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" event={"ID":"f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1","Type":"ContainerStarted","Data":"3891dc64f098047f92486a7ccd63aa1245594b087d784b36b091e694a526da3c"}
Jul 12 16:26:08.167436 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.167049    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:08.169903 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.169866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxmnn" event={"ID":"0ddd2226-2294-4921-bb87-8487685b86be","Type":"ContainerStarted","Data":"9ac7f12ebee685d9f8c7eaaf945b9a3089464253d39a835300aadd5a7125b95f"}
Jul 12 16:26:08.171669 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.171643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ldc5s" event={"ID":"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa","Type":"ContainerStarted","Data":"db13bf40aa3f6c4a375b34796f5157dfe89d34c657b1b634632ceddb38fc7896"}
Jul 12 16:26:08.173525 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.173499    2577 generic.go:356] "Generic (PLEG): container finished" podID="c87f7954-ca37-48c9-9a2d-37b388c91665" containerID="3b97c4cf8a896ad1902c7e52e21d99f8556f82ac2755ffb74c0b78f69d640536" exitCode=0
Jul 12 16:26:08.173645 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.173609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerDied","Data":"3b97c4cf8a896ad1902c7e52e21d99f8556f82ac2755ffb74c0b78f69d640536"}
Jul 12 16:26:08.173702 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.173678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"184d01f5edaba2494bb090292b97c50b732c1569f399ed7aad35bedde05a45cf"}
Jul 12 16:26:08.175129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.175108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c782j" event={"ID":"c48b7a86-f3e0-4190-a42e-6cf6533f8a78","Type":"ContainerStarted","Data":"2ec4cffa9f92e2fc5d6248305b8ddf57ab093d21d46cb860c72a624ba672807a"}
Jul 12 16:26:08.199721 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:08.199672    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56" podStartSLOduration=2.409101345 podStartE2EDuration="5.199651324s" totalImagesPullingTime="2.790549979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:26:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:08.198202863 +0000 UTC m=+66.056096251" watchObservedRunningTime="2026-07-12 16:26:08.199651324 +0000 UTC m=+66.057544712"
Jul 12 16:26:09.186025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:09.185855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c782j" event={"ID":"c48b7a86-f3e0-4190-a42e-6cf6533f8a78","Type":"ContainerStarted","Data":"407a1eb36717b8ad46f57cd6920711182f031e34aa3604da7d71650a6615d682"}
Jul 12 16:26:09.186025 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:09.185923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c782j" event={"ID":"c48b7a86-f3e0-4190-a42e-6cf6533f8a78","Type":"ContainerStarted","Data":"8c831f442eee91f372c216d77f800bb12cb020f503cd46d679ce55b48eb627b4"}
Jul 12 16:26:09.204436 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:09.204376    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c782j" podStartSLOduration=65.920577259 podStartE2EDuration="1m7.204352618s" totalImagesPullingTime="1.283775359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:09.204140967 +0000 UTC m=+67.062034368" watchObservedRunningTime="2026-07-12 16:26:09.204352618 +0000 UTC m=+67.062246007"
Jul 12 16:26:14.193753 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:14.193725    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64b8fd548-8fb56"
Jul 12 16:26:14.209367 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:14.209335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxmnn" event={"ID":"0ddd2226-2294-4921-bb87-8487685b86be","Type":"ContainerStarted","Data":"160966a909fec38888571cec0b15b9c6e4d87e53b76544bf182df18ab4dfe261"}
Jul 12 16:26:15.215207 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.215165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ldc5s" event={"ID":"e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa","Type":"ContainerStarted","Data":"db5b1bcaab21ea00e3141d378643ef6102bf3df81fe9fba014eea3bad723497c"}
Jul 12 16:26:15.218395 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"18dfcfe1f0a28ded9457ffe37b3f621a0218eb5fce4cab1fc99d34edbe6764e5"}
Jul 12 16:26:15.218526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"46645b2ca2987110e8c543d2f6aa2d7b5a47e4373e08a8f42624840b1b5e1224"}
Jul 12 16:26:15.218526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"cdf37da59a739044872d41d4dbb28452db8bf05801858a58b06801fd1285f9d7"}
Jul 12 16:26:15.218526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"8b405172e196407b5acb708538a9f0c1c521ab89aa70736e4589ccdfd7897eba"}
Jul 12 16:26:15.218638 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"43693949346b7ceeffa1f0e503b8acd84b48a81fbe6d6d58895d3b14b079c5e3"}
Jul 12 16:26:15.218638 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218602    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:26:15.218638 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.218618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c87f7954-ca37-48c9-9a2d-37b388c91665","Type":"ContainerStarted","Data":"ed9de59b6f8e611fd83048be3213bd9ce158ae7425ae327adab19af0c50d9bb2"}
Jul 12 16:26:15.232233 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.232187    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ldc5s" podStartSLOduration=66.761733317 podStartE2EDuration="1m13.232172487s" totalImagesPullingTime="6.47043917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:15.230845445 +0000 UTC m=+73.088738832" watchObservedRunningTime="2026-07-12 16:26:15.232172487 +0000 UTC m=+73.090065874"
Jul 12 16:26:15.247633 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.247585    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rxmnn" podStartSLOduration=66.80367157 podStartE2EDuration="1m13.247568825s" totalImagesPullingTime="6.443897255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:15.246910684 +0000 UTC m=+73.104804072" watchObservedRunningTime="2026-07-12 16:26:15.247568825 +0000 UTC m=+73.105462211"
Jul 12 16:26:15.278725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:15.278669    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.353832968 podStartE2EDuration="9.278644631s" totalImagesPullingTime="5.907535421s" totalInitContainerRuntime="17.276242ms" isStatefulPod=false podCreationTimestamp="2026-07-12 16:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:26:15.276583144 +0000 UTC m=+73.134476535" watchObservedRunningTime="2026-07-12 16:26:15.278644631 +0000 UTC m=+73.136538024"
Jul 12 16:26:17.131852 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:17.131814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:26:46.226992 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:26:46.226960    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rxmnn"
Jul 12 16:27:07.131723 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:27:07.131679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:27:07.151462 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:27:07.151432    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:27:07.426734 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:27:07.426653    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 16:29:17.518662 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.518628    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"]
Jul 12 16:29:17.521167 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.521140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.524746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.524725    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 16:29:17.525053 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.525032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 16:29:17.525167 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.525058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 16:29:17.525248 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.525176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xbsdr\""
Jul 12 16:29:17.525621 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.525600    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 16:29:17.541500 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.541458    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"]
Jul 12 16:29:17.618496 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.618433    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.618684 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.618518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-tmp\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.618684 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.618618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.618684 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.618664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-manifests\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.618854 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.618807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzdx\" (UniqueName: \"kubernetes.io/projected/9501af38-dfea-4de5-8dfe-e062e2ed7bab-kube-api-access-7qzdx\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.719595 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.719565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzdx\" (UniqueName: \"kubernetes.io/projected/9501af38-dfea-4de5-8dfe-e062e2ed7bab-kube-api-access-7qzdx\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.719803 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.719604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.719803 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.719625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-tmp\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.719803 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.719661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.719803 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.719687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-manifests\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.720131 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.720103    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-manifests\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.722075 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.722049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9501af38-dfea-4de5-8dfe-e062e2ed7bab-tmp\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.722618 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.722591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-apiservice-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.722853 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.722836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9501af38-dfea-4de5-8dfe-e062e2ed7bab-webhook-cert\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.728268 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.728235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzdx\" (UniqueName: \"kubernetes.io/projected/9501af38-dfea-4de5-8dfe-e062e2ed7bab-kube-api-access-7qzdx\") pod \"opendatahub-operator-controller-manager-869b4c4546-5xpb9\" (UID: \"9501af38-dfea-4de5-8dfe-e062e2ed7bab\") " pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:17.831533 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:17.831493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:18.003339 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:18.003304    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"]
Jul 12 16:29:18.006648 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:29:18.006618    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9501af38_dfea_4de5_8dfe_e062e2ed7bab.slice/crio-0f3664d8ddab8e13d6985d96a7ad9b1421138b03707fb572bc793642d0aef242 WatchSource:0}: Error finding container 0f3664d8ddab8e13d6985d96a7ad9b1421138b03707fb572bc793642d0aef242: Status 404 returned error can't find the container with id 0f3664d8ddab8e13d6985d96a7ad9b1421138b03707fb572bc793642d0aef242
Jul 12 16:29:18.893243 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:18.893205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9" event={"ID":"9501af38-dfea-4de5-8dfe-e062e2ed7bab","Type":"ContainerStarted","Data":"0f3664d8ddab8e13d6985d96a7ad9b1421138b03707fb572bc793642d0aef242"}
Jul 12 16:29:20.903027 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:20.902993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9" event={"ID":"9501af38-dfea-4de5-8dfe-e062e2ed7bab","Type":"ContainerStarted","Data":"f70af1929cbb40d1f4dc35472451a41cfdc2bad54755f6d27e81bdb5dde4aeee"}
Jul 12 16:29:21.907959 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:21.907932    2577 generic.go:356] "Generic (PLEG): container finished" podID="9501af38-dfea-4de5-8dfe-e062e2ed7bab" containerID="f70af1929cbb40d1f4dc35472451a41cfdc2bad54755f6d27e81bdb5dde4aeee" exitCode=0
Jul 12 16:29:21.908273 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:21.907969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9" event={"ID":"9501af38-dfea-4de5-8dfe-e062e2ed7bab","Type":"ContainerDied","Data":"f70af1929cbb40d1f4dc35472451a41cfdc2bad54755f6d27e81bdb5dde4aeee"}
Jul 12 16:29:22.914594 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:22.914554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9" event={"ID":"9501af38-dfea-4de5-8dfe-e062e2ed7bab","Type":"ContainerStarted","Data":"28bdd9344470c43900a7fb416f31f8482b6c553ea76c7e1b802a0244c5ea16d9"}
Jul 12 16:29:22.915065 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:22.914699    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:22.995454 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:22.995396    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9" podStartSLOduration=1.880826844 podStartE2EDuration="5.99537833s" totalImagesPullingTime="3.017488798s" totalInitContainerRuntime="1.097062688s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:22.990268733 +0000 UTC m=+260.848162122" watchObservedRunningTime="2026-07-12 16:29:22.99537833 +0000 UTC m=+260.853271716"
Jul 12 16:29:33.921326 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:33.921288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-869b4c4546-5xpb9"
Jul 12 16:29:42.518881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.518844    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"]
Jul 12 16:29:42.528579 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.528547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.531195 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.531167    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 12 16:29:42.531362 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.531205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 12 16:29:42.532334 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.532314    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xflvk\""
Jul 12 16:29:42.532459 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.532367    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 16:29:42.532459 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.532314    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 16:29:42.533387 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.533366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"]
Jul 12 16:29:42.641818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.641778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tmp\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.641818 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.641822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nphrg\" (UniqueName: \"kubernetes.io/projected/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-kube-api-access-nphrg\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.642040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.641875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.743041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.743003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.743217 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.743106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tmp\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.743217 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.743138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nphrg\" (UniqueName: \"kubernetes.io/projected/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-kube-api-access-nphrg\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.743217 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:29:42.743167    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 12 16:29:42.743397 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:29:42.743243    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs podName:fe3ed45f-a18b-4e27-a28a-e5ac311007c7 nodeName:}" failed. No retries permitted until 2026-07-12 16:29:43.243220919 +0000 UTC m=+281.101114305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs") pod "kube-auth-proxy-545795f48c-7bg4d" (UID: "fe3ed45f-a18b-4e27-a28a-e5ac311007c7") : secret "kube-auth-proxy-tls" not found
Jul 12 16:29:42.745459 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.745434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tmp\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:42.751657 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:42.751632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nphrg\" (UniqueName: \"kubernetes.io/projected/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-kube-api-access-nphrg\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:43.248566 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:43.248529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:43.250889 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:43.250867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe3ed45f-a18b-4e27-a28a-e5ac311007c7-tls-certs\") pod \"kube-auth-proxy-545795f48c-7bg4d\" (UID: \"fe3ed45f-a18b-4e27-a28a-e5ac311007c7\") " pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:43.440633 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:43.440593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"
Jul 12 16:29:43.573739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:43.573710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545795f48c-7bg4d"]
Jul 12 16:29:43.576367 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:29:43.576341    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3ed45f_a18b_4e27_a28a_e5ac311007c7.slice/crio-5ea5aca4acaa90e9653884679501573fd73849c62e3343ba2f89465a4403376d WatchSource:0}: Error finding container 5ea5aca4acaa90e9653884679501573fd73849c62e3343ba2f89465a4403376d: Status 404 returned error can't find the container with id 5ea5aca4acaa90e9653884679501573fd73849c62e3343ba2f89465a4403376d
Jul 12 16:29:43.994352 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:43.994312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d" event={"ID":"fe3ed45f-a18b-4e27-a28a-e5ac311007c7","Type":"ContainerStarted","Data":"5ea5aca4acaa90e9653884679501573fd73849c62e3343ba2f89465a4403376d"}
Jul 12 16:29:44.825145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.825092    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"]
Jul 12 16:29:44.827934 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.827904    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.833697 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.832899    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 16:29:44.833697 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.832947    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9z4mj\""
Jul 12 16:29:44.833697 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.833166    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 16:29:44.833697 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.833356    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 16:29:44.833697 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.833551    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 16:29:44.852138 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.852112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"]
Jul 12 16:29:44.964353 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964574 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964574 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964574 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964772 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964772 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:44.964772 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:44.964685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhkj\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-kube-api-access-zmhkj\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.065759 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.065950 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.065950 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.065950 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.065950 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhkj\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-kube-api-access-zmhkj\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.066167 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.066167 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.065997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.066865 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.066802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.068784 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.068734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.069063 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.069042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.069219 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.069192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.069761 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.069740    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.075031 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.075006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.075432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.075378    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhkj\" (UniqueName: \"kubernetes.io/projected/87ad2c51-b3b6-4060-836c-754d5bb3eb4d-kube-api-access-zmhkj\") pod \"istiod-openshift-gateway-94bb8fbfd-tp4j5\" (UID: \"87ad2c51-b3b6-4060-836c-754d5bb3eb4d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.142063 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.142028    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:45.298171 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.298138    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"]
Jul 12 16:29:45.300842 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.300812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.305271 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.305241    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 16:29:45.305758 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.305733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 16:29:45.306432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.306409    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 16:29:45.306562 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.306513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 16:29:45.306816 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.306799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 16:29:45.306957 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.306937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pgldg\""
Jul 12 16:29:45.324680 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.324647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"]
Jul 12 16:29:45.469764 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.469686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99nw\" (UniqueName: \"kubernetes.io/projected/e6275033-1d4c-4c88-b15a-a6c755177feb-kube-api-access-w99nw\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.469764 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.469759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-metrics-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.469956 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.469912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e6275033-1d4c-4c88-b15a-a6c755177feb-manager-config\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.469956 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.469948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.571160 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.571120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e6275033-1d4c-4c88-b15a-a6c755177feb-manager-config\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.571160 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.571161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.571408 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.571273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w99nw\" (UniqueName: \"kubernetes.io/projected/e6275033-1d4c-4c88-b15a-a6c755177feb-kube-api-access-w99nw\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.571408 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.571330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-metrics-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.571977 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.571951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e6275033-1d4c-4c88-b15a-a6c755177feb-manager-config\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.574045 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.574021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.574203 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.574074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e6275033-1d4c-4c88-b15a-a6c755177feb-metrics-cert\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.580185 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.580159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99nw\" (UniqueName: \"kubernetes.io/projected/e6275033-1d4c-4c88-b15a-a6c755177feb-kube-api-access-w99nw\") pod \"lws-controller-manager-6b84b79bc8-c27st\" (UID: \"e6275033-1d4c-4c88-b15a-a6c755177feb\") " pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.612150 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.612113    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:45.878125 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.878098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"]
Jul 12 16:29:45.880688 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:29:45.880661    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ad2c51_b3b6_4060_836c_754d5bb3eb4d.slice/crio-63e070fa29badb441d2454d7885874cbaa0c24a7d0451165b679e1714bc18ac1 WatchSource:0}: Error finding container 63e070fa29badb441d2454d7885874cbaa0c24a7d0451165b679e1714bc18ac1: Status 404 returned error can't find the container with id 63e070fa29badb441d2454d7885874cbaa0c24a7d0451165b679e1714bc18ac1
Jul 12 16:29:45.891780 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:45.891743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"]
Jul 12 16:29:45.899512 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:29:45.899469    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6275033_1d4c_4c88_b15a_a6c755177feb.slice/crio-6ad93cc08204774092b9119d6b7cf12345127bf00d5bc8cc5e8ce544c431f858 WatchSource:0}: Error finding container 6ad93cc08204774092b9119d6b7cf12345127bf00d5bc8cc5e8ce544c431f858: Status 404 returned error can't find the container with id 6ad93cc08204774092b9119d6b7cf12345127bf00d5bc8cc5e8ce544c431f858
Jul 12 16:29:46.004555 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:46.004451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5" event={"ID":"87ad2c51-b3b6-4060-836c-754d5bb3eb4d","Type":"ContainerStarted","Data":"63e070fa29badb441d2454d7885874cbaa0c24a7d0451165b679e1714bc18ac1"}
Jul 12 16:29:46.005959 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:46.005935    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d" event={"ID":"fe3ed45f-a18b-4e27-a28a-e5ac311007c7","Type":"ContainerStarted","Data":"62adc88dcac3cd04423d51226db14d3fab599e395405273e94654a0730c84b81"}
Jul 12 16:29:46.007090 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:46.007066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st" event={"ID":"e6275033-1d4c-4c88-b15a-a6c755177feb","Type":"ContainerStarted","Data":"6ad93cc08204774092b9119d6b7cf12345127bf00d5bc8cc5e8ce544c431f858"}
Jul 12 16:29:46.026813 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:46.026756    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545795f48c-7bg4d" podStartSLOduration=1.829790016 podStartE2EDuration="4.02673312s" totalImagesPullingTime="2.196943104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:46.026396041 +0000 UTC m=+283.884289429" watchObservedRunningTime="2026-07-12 16:29:46.02673312 +0000 UTC m=+283.884626514"
Jul 12 16:29:49.207590 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:49.207545    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:29:49.207960 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:49.207616    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:29:50.029628 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.029587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st" event={"ID":"e6275033-1d4c-4c88-b15a-a6c755177feb","Type":"ContainerStarted","Data":"2d8b5865b2de799c171723e652f417e7b5b77f75c97db2eb34cc802d6b8257ea"}
Jul 12 16:29:50.029839 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.029658    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:29:50.031127 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.031105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5" event={"ID":"87ad2c51-b3b6-4060-836c-754d5bb3eb4d","Type":"ContainerStarted","Data":"b4662dd5e1d2686c9fc777320e712b72853f955ca0b12f93845f03e3ae9a11c6"}
Jul 12 16:29:50.031248 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.031202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:29:50.032941 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.032918    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-tp4j5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 16:29:50.033041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.032959    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5" podUID="87ad2c51-b3b6-4060-836c-754d5bb3eb4d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 16:29:50.069879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.069831    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st" podStartSLOduration=1.765901166 podStartE2EDuration="5.069811738s" totalImagesPullingTime="3.303910572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:50.068590522 +0000 UTC m=+287.926483910" watchObservedRunningTime="2026-07-12 16:29:50.069811738 +0000 UTC m=+287.927705126"
Jul 12 16:29:50.106142 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:50.106084    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5" podStartSLOduration=2.782454152 podStartE2EDuration="6.106060977s" totalImagesPullingTime="3.323606825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:29:50.10476051 +0000 UTC m=+287.962653898" watchObservedRunningTime="2026-07-12 16:29:50.106060977 +0000 UTC m=+287.963954370"
Jul 12 16:29:51.036692 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:29:51.036660    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tp4j5"
Jul 12 16:30:01.038883 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:30:01.038851    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b84b79bc8-c27st"
Jul 12 16:30:02.517071 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:30:02.517039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:30:02.517562 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:30:02.517228    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:30:02.519778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:30:02.519757    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 16:35:02.541709 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:35:02.541670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:35:02.542606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:35:02.542582    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:40:02.571125 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:40:02.568260    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:40:02.571700 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:40:02.571034    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:45:00.148109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.148072    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:45:00.151304 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.151287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"
Jul 12 16:45:00.155430 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.155413    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-682rd\""
Jul 12 16:45:00.160205 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.160188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"
Jul 12 16:45:00.171984 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.171959    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:45:00.290863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.290838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:45:00.293865 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:45:00.293819    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038632ea_3e73_46eb_ad3b_098cb1aab100.slice/crio-da9117a573005fb9189adb494273d322b312e18ff1cf83e3ce08048dd156d997 WatchSource:0}: Error finding container da9117a573005fb9189adb494273d322b312e18ff1cf83e3ce08048dd156d997: Status 404 returned error can't find the container with id da9117a573005fb9189adb494273d322b312e18ff1cf83e3ce08048dd156d997
Jul 12 16:45:00.295931 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.295914    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 16:45:00.601090 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:00.601054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" event={"ID":"038632ea-3e73-46eb-ad3b-098cb1aab100","Type":"ContainerStarted","Data":"da9117a573005fb9189adb494273d322b312e18ff1cf83e3ce08048dd156d997"}
Jul 12 16:45:02.600092 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:02.600064    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:45:02.601080 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:02.601056    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:45:04.620602 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:04.620562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" event={"ID":"038632ea-3e73-46eb-ad3b-098cb1aab100","Type":"ContainerStarted","Data":"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"}
Jul 12 16:45:04.639299 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:45:04.639243    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" podStartSLOduration=1.458197621 podStartE2EDuration="4.639229446s" totalImagesPullingTime="3.181031825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:45:04.637264856 +0000 UTC m=+1202.495158242" watchObservedRunningTime="2026-07-12 16:45:04.639229446 +0000 UTC m=+1202.497122833"
Jul 12 16:46:00.010650 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:00.010570    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:46:00.011146 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:00.010779    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" podUID="038632ea-3e73-46eb-ad3b-098cb1aab100" containerName="cleanup" containerID="cri-o://55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e" gracePeriod=30
Jul 12 16:46:30.178459 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.178429    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"
Jul 12 16:46:30.990886 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.990806    2577 generic.go:356] "Generic (PLEG): container finished" podID="038632ea-3e73-46eb-ad3b-098cb1aab100" containerID="55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e" exitCode=137
Jul 12 16:46:30.990886 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.990847    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"
Jul 12 16:46:30.990886 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.990861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" event={"ID":"038632ea-3e73-46eb-ad3b-098cb1aab100","Type":"ContainerDied","Data":"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"}
Jul 12 16:46:30.991209 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.990902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2" event={"ID":"038632ea-3e73-46eb-ad3b-098cb1aab100","Type":"ContainerDied","Data":"da9117a573005fb9189adb494273d322b312e18ff1cf83e3ce08048dd156d997"}
Jul 12 16:46:30.991209 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.990937    2577 scope.go:117] "RemoveContainer" containerID="55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"
Jul 12 16:46:30.999695 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:30.999675    2577 scope.go:117] "RemoveContainer" containerID="55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"
Jul 12 16:46:31.000004 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:46:30.999982    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e\": container with ID starting with 55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e not found: ID does not exist" containerID="55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"
Jul 12 16:46:31.000052 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:31.000014    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e"} err="failed to get container status \"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e\": rpc error: code = NotFound desc = could not find container \"55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e\": container with ID starting with 55d48806bc3fdf4e7eec2e4859e0f8d97163d123c88c1e4056965df384b7739e not found: ID does not exist"
Jul 12 16:46:31.006969 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:31.006943    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:46:31.010947 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:31.010920    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731245-5w8d2"]
Jul 12 16:46:32.631396 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:46:32.631361    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038632ea-3e73-46eb-ad3b-098cb1aab100" path="/var/lib/kubelet/pods/038632ea-3e73-46eb-ad3b-098cb1aab100/volumes"
Jul 12 16:49:29.082110 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.082077    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:29.082530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.082412    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038632ea-3e73-46eb-ad3b-098cb1aab100" containerName="cleanup"
Jul 12 16:49:29.082530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.082423    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="038632ea-3e73-46eb-ad3b-098cb1aab100" containerName="cleanup"
Jul 12 16:49:29.082530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.082504    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="038632ea-3e73-46eb-ad3b-098cb1aab100" containerName="cleanup"
Jul 12 16:49:29.085601 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.085582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.088169 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.088139    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:49:29.088294 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.088176    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:49:29.088890 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.088872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-755d03bc-serving-cert\""
Jul 12 16:49:29.088977 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.088912    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:49:29.094611 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.094591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:29.202391 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.202361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.202595 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.202416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.202595 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.202447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndq8\" (UniqueName: \"kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.303033 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.302990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.303033 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.303041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndq8\" (UniqueName: \"kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.303265 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.303088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.303746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.303719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.305471 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.305447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.323156 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.323130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndq8\" (UniqueName: \"kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8\") pod \"maas-api-e2e-ait-755d03bc-865888b888-h6q94\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.397147 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.397060    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:29.529223 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.529189    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:29.532651 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:49:29.532625    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f631ee_cdcc_4747_b955_97e3c10ea339.slice/crio-92317145d892452a402cd256cce6b58c59140aca306f6c02e95b7cba95a0f266 WatchSource:0}: Error finding container 92317145d892452a402cd256cce6b58c59140aca306f6c02e95b7cba95a0f266: Status 404 returned error can't find the container with id 92317145d892452a402cd256cce6b58c59140aca306f6c02e95b7cba95a0f266
Jul 12 16:49:29.697248 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:29.697158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" event={"ID":"b2f631ee-cdcc-4747-b955-97e3c10ea339","Type":"ContainerStarted","Data":"92317145d892452a402cd256cce6b58c59140aca306f6c02e95b7cba95a0f266"}
Jul 12 16:49:32.711266 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:32.711225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" event={"ID":"b2f631ee-cdcc-4747-b955-97e3c10ea339","Type":"ContainerStarted","Data":"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"}
Jul 12 16:49:32.711685 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:32.711300    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:32.729657 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:32.729604    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" podStartSLOduration=1.528098155 podStartE2EDuration="3.729587734s" totalImagesPullingTime="2.201489579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:49:32.727936898 +0000 UTC m=+1470.585830285" watchObservedRunningTime="2026-07-12 16:49:32.729587734 +0000 UTC m=+1470.587481121"
Jul 12 16:49:34.480658 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:34.480622    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:34.719410 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:34.719345    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" podUID="b2f631ee-cdcc-4747-b955-97e3c10ea339" containerName="maas-api" containerID="cri-o://9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988" gracePeriod=30
Jul 12 16:49:34.963302 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:34.963276    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:35.055131 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.055047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls\") pod \"b2f631ee-cdcc-4747-b955-97e3c10ea339\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") "
Jul 12 16:49:35.055131 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.055086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ndq8\" (UniqueName: \"kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8\") pod \"b2f631ee-cdcc-4747-b955-97e3c10ea339\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") "
Jul 12 16:49:35.055343 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.055139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca\") pod \"b2f631ee-cdcc-4747-b955-97e3c10ea339\" (UID: \"b2f631ee-cdcc-4747-b955-97e3c10ea339\") "
Jul 12 16:49:35.055578 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.055544    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b2f631ee-cdcc-4747-b955-97e3c10ea339" (UID: "b2f631ee-cdcc-4747-b955-97e3c10ea339"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:49:35.057206 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.057182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8" (OuterVolumeSpecName: "kube-api-access-6ndq8") pod "b2f631ee-cdcc-4747-b955-97e3c10ea339" (UID: "b2f631ee-cdcc-4747-b955-97e3c10ea339"). InnerVolumeSpecName "kube-api-access-6ndq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:49:35.057274 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.057182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b2f631ee-cdcc-4747-b955-97e3c10ea339" (UID: "b2f631ee-cdcc-4747-b955-97e3c10ea339"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:49:35.156230 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.156190    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f631ee-cdcc-4747-b955-97e3c10ea339-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:35.156230 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.156219    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2f631ee-cdcc-4747-b955-97e3c10ea339-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:35.156230 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.156229    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ndq8\" (UniqueName: \"kubernetes.io/projected/b2f631ee-cdcc-4747-b955-97e3c10ea339-kube-api-access-6ndq8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:35.724339 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.724304    2577 generic.go:356] "Generic (PLEG): container finished" podID="b2f631ee-cdcc-4747-b955-97e3c10ea339" containerID="9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988" exitCode=0
Jul 12 16:49:35.724746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.724346    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"
Jul 12 16:49:35.724746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.724356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" event={"ID":"b2f631ee-cdcc-4747-b955-97e3c10ea339","Type":"ContainerDied","Data":"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"}
Jul 12 16:49:35.724746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.724398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94" event={"ID":"b2f631ee-cdcc-4747-b955-97e3c10ea339","Type":"ContainerDied","Data":"92317145d892452a402cd256cce6b58c59140aca306f6c02e95b7cba95a0f266"}
Jul 12 16:49:35.724746 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.724421    2577 scope.go:117] "RemoveContainer" containerID="9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"
Jul 12 16:49:35.732535 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.732517    2577 scope.go:117] "RemoveContainer" containerID="9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"
Jul 12 16:49:35.732778 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:49:35.732760    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988\": container with ID starting with 9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988 not found: ID does not exist" containerID="9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"
Jul 12 16:49:35.732820 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.732785    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988"} err="failed to get container status \"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988\": rpc error: code = NotFound desc = could not find container \"9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988\": container with ID starting with 9b2e35c42753948241402cb99b47f660af2c064d199f1adffac8f9cce6dbe988 not found: ID does not exist"
Jul 12 16:49:35.745032 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.745005    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:35.747924 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:35.747897    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-755d03bc-865888b888-h6q94"]
Jul 12 16:49:36.631695 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:36.631662    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f631ee-cdcc-4747-b955-97e3c10ea339" path="/var/lib/kubelet/pods/b2f631ee-cdcc-4747-b955-97e3c10ea339/volumes"
Jul 12 16:49:41.642361 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.642326    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:41.642944 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.642923    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f631ee-cdcc-4747-b955-97e3c10ea339" containerName="maas-api"
Jul 12 16:49:41.643026 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.642946    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f631ee-cdcc-4747-b955-97e3c10ea339" containerName="maas-api"
Jul 12 16:49:41.643082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.643027    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f631ee-cdcc-4747-b955-97e3c10ea339" containerName="maas-api"
Jul 12 16:49:41.647310 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.647287    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.649767 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.649739    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-183966ff-serving-cert\""
Jul 12 16:49:41.649871 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.649777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:49:41.649871 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.649778    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:49:41.650668 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.650652    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:49:41.656607 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.656584    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:41.819755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.819691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.819937 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.819780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw9h8\" (UniqueName: \"kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.819937 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.819849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.921053 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.920969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw9h8\" (UniqueName: \"kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.921053 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.921045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.921231 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.921077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.921705 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.921681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.923547 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.923521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.928710 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.928688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw9h8\" (UniqueName: \"kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8\") pod \"maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:41.959232 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:41.959198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:42.091836 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:42.091801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:42.094730 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:49:42.094698    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb5320e_1fa9_41e7_85d5_1d4ddd9baf8e.slice/crio-dfa3d405ccea4a875f50daa22cc778932a99c30efeadf031df787113e806be6f WatchSource:0}: Error finding container dfa3d405ccea4a875f50daa22cc778932a99c30efeadf031df787113e806be6f: Status 404 returned error can't find the container with id dfa3d405ccea4a875f50daa22cc778932a99c30efeadf031df787113e806be6f
Jul 12 16:49:42.759588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:42.759495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" event={"ID":"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e","Type":"ContainerStarted","Data":"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"}
Jul 12 16:49:42.759588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:42.759548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" event={"ID":"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e","Type":"ContainerStarted","Data":"dfa3d405ccea4a875f50daa22cc778932a99c30efeadf031df787113e806be6f"}
Jul 12 16:49:42.759588 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:42.759587    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:42.781551 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:42.781509    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" podStartSLOduration=1.448029422 podStartE2EDuration="1.78149402s" totalImagesPullingTime="333.464598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:49:42.780582769 +0000 UTC m=+1480.638476159" watchObservedRunningTime="2026-07-12 16:49:42.78149402 +0000 UTC m=+1480.639387399"
Jul 12 16:49:47.028634 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.028605    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:47.029061 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.028796    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" podUID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" containerName="maas-api" containerID="cri-o://86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03" gracePeriod=30
Jul 12 16:49:47.034999 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.034973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:47.271320 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.271296    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:47.361991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.361959    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca\") pod \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") "
Jul 12 16:49:47.362179 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.362011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw9h8\" (UniqueName: \"kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8\") pod \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") "
Jul 12 16:49:47.362179 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.362114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls\") pod \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\" (UID: \"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e\") "
Jul 12 16:49:47.362346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.362318    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" (UID: "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:49:47.364185 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.364157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8" (OuterVolumeSpecName: "kube-api-access-kw9h8") pod "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" (UID: "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e"). InnerVolumeSpecName "kube-api-access-kw9h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:49:47.364274 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.364185    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" (UID: "5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:49:47.463726 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.463688    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:47.463726 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.463718    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:47.463726 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.463731    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw9h8\" (UniqueName: \"kubernetes.io/projected/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e-kube-api-access-kw9h8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:49:47.782228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.782142    2577 generic.go:356] "Generic (PLEG): container finished" podID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" containerID="86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03" exitCode=0
Jul 12 16:49:47.782228 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.782189    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"
Jul 12 16:49:47.782396 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.782225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" event={"ID":"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e","Type":"ContainerDied","Data":"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"}
Jul 12 16:49:47.782396 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.782281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6" event={"ID":"5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e","Type":"ContainerDied","Data":"dfa3d405ccea4a875f50daa22cc778932a99c30efeadf031df787113e806be6f"}
Jul 12 16:49:47.782396 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.782306    2577 scope.go:117] "RemoveContainer" containerID="86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"
Jul 12 16:49:47.791079 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.791060    2577 scope.go:117] "RemoveContainer" containerID="86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"
Jul 12 16:49:47.791317 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:49:47.791299    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03\": container with ID starting with 86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03 not found: ID does not exist" containerID="86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"
Jul 12 16:49:47.791361 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.791326    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03"} err="failed to get container status \"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03\": rpc error: code = NotFound desc = could not find container \"86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03\": container with ID starting with 86b1bad1421c7c3e73422431904d22bd10434e70fa207643b0d41a18026d3e03 not found: ID does not exist"
Jul 12 16:49:47.803397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.803368    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:47.805198 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:47.805175    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-183966ff-5f6d78b4f4-hjxm6"]
Jul 12 16:49:48.631225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:48.631191    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" path="/var/lib/kubelet/pods/5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e/volumes"
Jul 12 16:49:59.972834 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.972789    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:49:59.973408 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.973267    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" containerName="maas-api"
Jul 12 16:49:59.973408 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.973286    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" containerName="maas-api"
Jul 12 16:49:59.973408 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.973374    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb5320e-1fa9-41e7-85d5-1d4ddd9baf8e" containerName="maas-api"
Jul 12 16:49:59.977204 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.977180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:49:59.980311 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.980287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b44a9a33-serving-cert\""
Jul 12 16:49:59.980423 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.980385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:49:59.980465 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.980454    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:49:59.981187 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.981171    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:49:59.987351 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:49:59.987326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:50:00.072917 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.072882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8bf8\" (UniqueName: \"kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.073086 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.072945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.073086 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.073008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.173444 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.173409    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.173643 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.173456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.173643 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.173564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8bf8\" (UniqueName: \"kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.174140 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.174115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.175906 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.175882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.190170 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.190144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8bf8\" (UniqueName: \"kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8\") pod \"maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.288643 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.288542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:00.426813 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.426778    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:50:00.430401 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:50:00.430374    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb242f5_c484_4afc_ba51_1306e90411ad.slice/crio-c4bedabb65cf0f9a864647508dca851ba1ca878a7d5fa59b16c54c1c7b8abac7 WatchSource:0}: Error finding container c4bedabb65cf0f9a864647508dca851ba1ca878a7d5fa59b16c54c1c7b8abac7: Status 404 returned error can't find the container with id c4bedabb65cf0f9a864647508dca851ba1ca878a7d5fa59b16c54c1c7b8abac7
Jul 12 16:50:00.432132 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.432116    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 16:50:00.837753 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:00.837723    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" event={"ID":"2fb242f5-c484-4afc-ba51-1306e90411ad","Type":"ContainerStarted","Data":"c4bedabb65cf0f9a864647508dca851ba1ca878a7d5fa59b16c54c1c7b8abac7"}
Jul 12 16:50:01.843579 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:01.843532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" event={"ID":"2fb242f5-c484-4afc-ba51-1306e90411ad","Type":"ContainerStarted","Data":"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"}
Jul 12 16:50:01.843980 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:01.843814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:01.861585 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:01.861535    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" podStartSLOduration=2.482950303 podStartE2EDuration="2.861519337s" totalImagesPullingTime="378.569034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:50:01.859350529 +0000 UTC m=+1499.717243916" watchObservedRunningTime="2026-07-12 16:50:01.861519337 +0000 UTC m=+1499.719412723"
Jul 12 16:50:02.627134 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:02.627101    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:50:02.629066 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:02.629044    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:50:04.612576 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.612538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:50:04.613029 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.612743    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" podUID="2fb242f5-c484-4afc-ba51-1306e90411ad" containerName="maas-api" containerID="cri-o://3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021" gracePeriod=30
Jul 12 16:50:04.857129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.857098    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:04.857801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.857777    2577 generic.go:356] "Generic (PLEG): container finished" podID="2fb242f5-c484-4afc-ba51-1306e90411ad" containerID="3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021" exitCode=0
Jul 12 16:50:04.857906 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.857846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" event={"ID":"2fb242f5-c484-4afc-ba51-1306e90411ad","Type":"ContainerDied","Data":"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"}
Jul 12 16:50:04.857906 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.857898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2" event={"ID":"2fb242f5-c484-4afc-ba51-1306e90411ad","Type":"ContainerDied","Data":"c4bedabb65cf0f9a864647508dca851ba1ca878a7d5fa59b16c54c1c7b8abac7"}
Jul 12 16:50:04.857982 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.857921    2577 scope.go:117] "RemoveContainer" containerID="3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"
Jul 12 16:50:04.865529 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.865501    2577 scope.go:117] "RemoveContainer" containerID="3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"
Jul 12 16:50:04.865776 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:50:04.865759    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021\": container with ID starting with 3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021 not found: ID does not exist" containerID="3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"
Jul 12 16:50:04.865822 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.865785    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021"} err="failed to get container status \"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021\": rpc error: code = NotFound desc = could not find container \"3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021\": container with ID starting with 3ed87a96a8353e9418a707f687aaaaa2acd996ad34fa42bc65de9f8774a10021 not found: ID does not exist"
Jul 12 16:50:04.916246 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.916209    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca\") pod \"2fb242f5-c484-4afc-ba51-1306e90411ad\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") "
Jul 12 16:50:04.916418 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.916272    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls\") pod \"2fb242f5-c484-4afc-ba51-1306e90411ad\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") "
Jul 12 16:50:04.916418 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.916321    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8bf8\" (UniqueName: \"kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8\") pod \"2fb242f5-c484-4afc-ba51-1306e90411ad\" (UID: \"2fb242f5-c484-4afc-ba51-1306e90411ad\") "
Jul 12 16:50:04.916606 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.916586    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fb242f5-c484-4afc-ba51-1306e90411ad" (UID: "2fb242f5-c484-4afc-ba51-1306e90411ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:50:04.918366 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.918339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fb242f5-c484-4afc-ba51-1306e90411ad" (UID: "2fb242f5-c484-4afc-ba51-1306e90411ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:50:04.918466 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:04.918367    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8" (OuterVolumeSpecName: "kube-api-access-b8bf8") pod "2fb242f5-c484-4afc-ba51-1306e90411ad" (UID: "2fb242f5-c484-4afc-ba51-1306e90411ad"). InnerVolumeSpecName "kube-api-access-b8bf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:50:05.017725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.017691    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb242f5-c484-4afc-ba51-1306e90411ad-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:50:05.017725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.017721    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb242f5-c484-4afc-ba51-1306e90411ad-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:50:05.017725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.017732    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8bf8\" (UniqueName: \"kubernetes.io/projected/2fb242f5-c484-4afc-ba51-1306e90411ad-kube-api-access-b8bf8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:50:05.862090 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.862061    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"
Jul 12 16:50:05.886339 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.886308    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:50:05.889393 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:05.889367    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b44a9a33-5bd89997f7-pqxg2"]
Jul 12 16:50:06.631122 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:50:06.631085    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb242f5-c484-4afc-ba51-1306e90411ad" path="/var/lib/kubelet/pods/2fb242f5-c484-4afc-ba51-1306e90411ad/volumes"
Jul 12 16:51:48.839260 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.839223    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:51:48.839756 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.839537    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb242f5-c484-4afc-ba51-1306e90411ad" containerName="maas-api"
Jul 12 16:51:48.839756 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.839548    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb242f5-c484-4afc-ba51-1306e90411ad" containerName="maas-api"
Jul 12 16:51:48.839756 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.839611    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb242f5-c484-4afc-ba51-1306e90411ad" containerName="maas-api"
Jul 12 16:51:48.842389 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.842374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:48.845267 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.845235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:51:48.845399 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.845274    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:51:48.846068 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.846049    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-048a61f7-serving-cert\""
Jul 12 16:51:48.846130 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.846067    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:51:48.851745 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.851725    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:51:48.930770 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.930741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6f8\" (UniqueName: \"kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:48.930770 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.930789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:48.931041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:48.930842    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.032322 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.032289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6f8\" (UniqueName: \"kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.032530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.032339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.032530 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.032359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.032530 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:51:49.032470    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-serving-cert: secret "maas-api-e2e-mt-048a61f7-serving-cert" not found
Jul 12 16:51:49.032666 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:51:49.032548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls podName:6b7ace3d-b823-441e-9387-1294072f4fde nodeName:}" failed. No retries permitted until 2026-07-12 16:51:49.532533349 +0000 UTC m=+1607.390426714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls") pod "maas-api-e2e-mt-048a61f7-66864b977f-dgklp" (UID: "6b7ace3d-b823-441e-9387-1294072f4fde") : secret "maas-api-e2e-mt-048a61f7-serving-cert" not found
Jul 12 16:51:49.033039 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.033021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.043502 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.043464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6f8\" (UniqueName: \"kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.537028 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.536987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.539375 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.539348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") pod \"maas-api-e2e-mt-048a61f7-66864b977f-dgklp\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.753739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.753694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:49.884129 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:49.884093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:51:49.887316 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:51:49.887290    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7ace3d_b823_441e_9387_1294072f4fde.slice/crio-bd351229b7559c4ff2303da1b60b1103bfc19c6adc0797b7b8b58c959aa55303 WatchSource:0}: Error finding container bd351229b7559c4ff2303da1b60b1103bfc19c6adc0797b7b8b58c959aa55303: Status 404 returned error can't find the container with id bd351229b7559c4ff2303da1b60b1103bfc19c6adc0797b7b8b58c959aa55303
Jul 12 16:51:50.273015 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:50.272978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" event={"ID":"6b7ace3d-b823-441e-9387-1294072f4fde","Type":"ContainerStarted","Data":"bd351229b7559c4ff2303da1b60b1103bfc19c6adc0797b7b8b58c959aa55303"}
Jul 12 16:51:51.278439 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:51.278405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" event={"ID":"6b7ace3d-b823-441e-9387-1294072f4fde","Type":"ContainerStarted","Data":"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"}
Jul 12 16:51:51.278854 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:51.278487    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:51:51.295858 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:51.295808    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" podStartSLOduration=2.876706066 podStartE2EDuration="3.295789597s" totalImagesPullingTime="419.083531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:51:51.293640258 +0000 UTC m=+1609.151533644" watchObservedRunningTime="2026-07-12 16:51:51.295789597 +0000 UTC m=+1609.153682984"
Jul 12 16:51:57.288191 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:51:57.288162    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:52:00.939289 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:00.939253    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:52:00.939755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:00.939448    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" podUID="6b7ace3d-b823-441e-9387-1294072f4fde" containerName="maas-api" containerID="cri-o://3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff" gracePeriod=30
Jul 12 16:52:01.181206 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.181181    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:52:01.237509 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.237380    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") pod \"6b7ace3d-b823-441e-9387-1294072f4fde\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") "
Jul 12 16:52:01.237509 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.237450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx6f8\" (UniqueName: \"kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8\") pod \"6b7ace3d-b823-441e-9387-1294072f4fde\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") "
Jul 12 16:52:01.237732 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.237523    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca\") pod \"6b7ace3d-b823-441e-9387-1294072f4fde\" (UID: \"6b7ace3d-b823-441e-9387-1294072f4fde\") "
Jul 12 16:52:01.237947 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.237916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b7ace3d-b823-441e-9387-1294072f4fde" (UID: "6b7ace3d-b823-441e-9387-1294072f4fde"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:52:01.239704 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.239678    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8" (OuterVolumeSpecName: "kube-api-access-vx6f8") pod "6b7ace3d-b823-441e-9387-1294072f4fde" (UID: "6b7ace3d-b823-441e-9387-1294072f4fde"). InnerVolumeSpecName "kube-api-access-vx6f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:52:01.239994 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.239977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b7ace3d-b823-441e-9387-1294072f4fde" (UID: "6b7ace3d-b823-441e-9387-1294072f4fde"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:52:01.316056 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.316019    2577 generic.go:356] "Generic (PLEG): container finished" podID="6b7ace3d-b823-441e-9387-1294072f4fde" containerID="3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff" exitCode=0
Jul 12 16:52:01.316225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.316060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" event={"ID":"6b7ace3d-b823-441e-9387-1294072f4fde","Type":"ContainerDied","Data":"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"}
Jul 12 16:52:01.316225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.316087    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"
Jul 12 16:52:01.316225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.316117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp" event={"ID":"6b7ace3d-b823-441e-9387-1294072f4fde","Type":"ContainerDied","Data":"bd351229b7559c4ff2303da1b60b1103bfc19c6adc0797b7b8b58c959aa55303"}
Jul 12 16:52:01.316225 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.316139    2577 scope.go:117] "RemoveContainer" containerID="3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"
Jul 12 16:52:01.324687 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.324671    2577 scope.go:117] "RemoveContainer" containerID="3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"
Jul 12 16:52:01.324950 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:52:01.324931    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff\": container with ID starting with 3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff not found: ID does not exist" containerID="3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"
Jul 12 16:52:01.324995 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.324959    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff"} err="failed to get container status \"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff\": rpc error: code = NotFound desc = could not find container \"3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff\": container with ID starting with 3ddd67639f0f37200432e2cf6d6948620ba698241f3b2ea141f0bd631d8719ff not found: ID does not exist"
Jul 12 16:52:01.336236 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.336210    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:52:01.338963 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.338948    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx6f8\" (UniqueName: \"kubernetes.io/projected/6b7ace3d-b823-441e-9387-1294072f4fde-kube-api-access-vx6f8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:52:01.339018 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.338965    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b7ace3d-b823-441e-9387-1294072f4fde-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:52:01.339018 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.338978    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b7ace3d-b823-441e-9387-1294072f4fde-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:52:01.342069 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:01.342041    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-048a61f7-66864b977f-dgklp"]
Jul 12 16:52:02.631531 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:02.631496    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7ace3d-b823-441e-9387-1294072f4fde" path="/var/lib/kubelet/pods/6b7ace3d-b823-441e-9387-1294072f4fde/volumes"
Jul 12 16:52:28.974611 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.974572    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:52:28.975069 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.974912    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7ace3d-b823-441e-9387-1294072f4fde" containerName="maas-api"
Jul 12 16:52:28.975069 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.974923    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7ace3d-b823-441e-9387-1294072f4fde" containerName="maas-api"
Jul 12 16:52:28.975069 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.974980    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7ace3d-b823-441e-9387-1294072f4fde" containerName="maas-api"
Jul 12 16:52:28.978041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.978024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:28.980548 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.980525    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:52:28.980667 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.980543    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-44bf2bf1-serving-cert\""
Jul 12 16:52:28.980667 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.980642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:52:28.981535 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.981515    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:52:28.988626 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:28.988599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:52:29.090539 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.090501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.090702 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.090575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mr8\" (UniqueName: \"kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.090702 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.090601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.191866 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.191834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.192051 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.191987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mr8\" (UniqueName: \"kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.192051 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.192031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.192498 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.192460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.194499 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.194450    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.200105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.200070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mr8\" (UniqueName: \"kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8\") pod \"maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.289160 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.289065    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:29.423761 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:29.423727    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:52:29.426743 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:52:29.426713    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d8b601_42fa_4a60_8c7c_dd23e0103ada.slice/crio-17bdc8a6941685832fbb973f741073fa58db7d00bedb278701b46cb8e18386f9 WatchSource:0}: Error finding container 17bdc8a6941685832fbb973f741073fa58db7d00bedb278701b46cb8e18386f9: Status 404 returned error can't find the container with id 17bdc8a6941685832fbb973f741073fa58db7d00bedb278701b46cb8e18386f9
Jul 12 16:52:30.431028 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:30.430995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" event={"ID":"01d8b601-42fa-4a60-8c7c-dd23e0103ada","Type":"ContainerStarted","Data":"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"}
Jul 12 16:52:30.431432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:30.431044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" event={"ID":"01d8b601-42fa-4a60-8c7c-dd23e0103ada","Type":"ContainerStarted","Data":"17bdc8a6941685832fbb973f741073fa58db7d00bedb278701b46cb8e18386f9"}
Jul 12 16:52:30.431432 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:30.431130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:30.450356 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:30.450302    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" podStartSLOduration=2.130320882 podStartE2EDuration="2.450283757s" totalImagesPullingTime="319.962875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:52:30.449586248 +0000 UTC m=+1648.307479647" watchObservedRunningTime="2026-07-12 16:52:30.450283757 +0000 UTC m=+1648.308177145"
Jul 12 16:52:36.440500 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:36.440448    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:52:49.771798 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.771759    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:52:49.775343 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.775321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.777797 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.777771    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-44bf2bf1\"/\"kube-root-ca.crt\""
Jul 12 16:52:49.778669 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.778647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-44bf2bf1\"/\"default-dockercfg-dzbbh\""
Jul 12 16:52:49.778809 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.778647    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-44bf2bf1\"/\"openshift-service-ca.crt\""
Jul 12 16:52:49.778879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.778816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-44bf2bf1\"/\"e2e-lifecycle-model-44bf2bf1-kserve-self-signed-certs\""
Jul 12 16:52:49.784136 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.784114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:52:49.858416 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.858629 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.858629 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.858629 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.858629 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.858776 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.858670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jlx\" (UniqueName: \"kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959221 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959417 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959417 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jlx\" (UniqueName: \"kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959417 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959417 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959660 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959660 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959762 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.959901 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.959884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.961569 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.961544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.961801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.961783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:49.966801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:49.966773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jlx\" (UniqueName: \"kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx\") pod \"e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") " pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:50.102059 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:50.102027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:52:50.231808 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:50.231776    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:52:50.235214 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:52:50.235187    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6327d081_20e2_4afc_8218_c5a58ee2953c.slice/crio-8b97a458316efd0171d90480c8e8be161e2584dbde0215f5b89fb69d925974a4 WatchSource:0}: Error finding container 8b97a458316efd0171d90480c8e8be161e2584dbde0215f5b89fb69d925974a4: Status 404 returned error can't find the container with id 8b97a458316efd0171d90480c8e8be161e2584dbde0215f5b89fb69d925974a4
Jul 12 16:52:50.520413 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:50.520319    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" event={"ID":"6327d081-20e2-4afc-8218-c5a58ee2953c","Type":"ContainerStarted","Data":"8b97a458316efd0171d90480c8e8be161e2584dbde0215f5b89fb69d925974a4"}
Jul 12 16:52:51.526375 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:51.526340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" event={"ID":"6327d081-20e2-4afc-8218-c5a58ee2953c","Type":"ContainerStarted","Data":"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"}
Jul 12 16:52:51.544248 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:52:51.544199    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" podStartSLOduration=1.449331354 podStartE2EDuration="2.544184117s" totalImagesPullingTime="1.094852763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:52:51.543600575 +0000 UTC m=+1669.401493963" watchObservedRunningTime="2026-07-12 16:52:51.544184117 +0000 UTC m=+1669.402077581"
Jul 12 16:53:00.102550 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:00.102514    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:00.103027 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:00.102572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:00.115407 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:00.115380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:00.574367 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:00.574344    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:21.864792 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:21.864756    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:53:21.867142 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:21.865030    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" podUID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" containerName="maas-api" containerID="cri-o://06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9" gracePeriod=30
Jul 12 16:53:22.100934 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.100908    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:53:22.234611 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.234523    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls\") pod \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") "
Jul 12 16:53:22.234611 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.234582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4mr8\" (UniqueName: \"kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8\") pod \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") "
Jul 12 16:53:22.234811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.234672    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca\") pod \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\" (UID: \"01d8b601-42fa-4a60-8c7c-dd23e0103ada\") "
Jul 12 16:53:22.235059 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.235026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01d8b601-42fa-4a60-8c7c-dd23e0103ada" (UID: "01d8b601-42fa-4a60-8c7c-dd23e0103ada"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:53:22.236725 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.236702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01d8b601-42fa-4a60-8c7c-dd23e0103ada" (UID: "01d8b601-42fa-4a60-8c7c-dd23e0103ada"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:53:22.236822 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.236769    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8" (OuterVolumeSpecName: "kube-api-access-w4mr8") pod "01d8b601-42fa-4a60-8c7c-dd23e0103ada" (UID: "01d8b601-42fa-4a60-8c7c-dd23e0103ada"). InnerVolumeSpecName "kube-api-access-w4mr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:53:22.335713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.335671    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01d8b601-42fa-4a60-8c7c-dd23e0103ada-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:22.335713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.335706    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01d8b601-42fa-4a60-8c7c-dd23e0103ada-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:22.335713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.335716    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4mr8\" (UniqueName: \"kubernetes.io/projected/01d8b601-42fa-4a60-8c7c-dd23e0103ada-kube-api-access-w4mr8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:22.655212 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.655173    2577 generic.go:356] "Generic (PLEG): container finished" podID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" containerID="06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9" exitCode=0
Jul 12 16:53:22.655347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.655217    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"
Jul 12 16:53:22.655347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.655257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" event={"ID":"01d8b601-42fa-4a60-8c7c-dd23e0103ada","Type":"ContainerDied","Data":"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"}
Jul 12 16:53:22.655347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.655310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw" event={"ID":"01d8b601-42fa-4a60-8c7c-dd23e0103ada","Type":"ContainerDied","Data":"17bdc8a6941685832fbb973f741073fa58db7d00bedb278701b46cb8e18386f9"}
Jul 12 16:53:22.655347 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.655331    2577 scope.go:117] "RemoveContainer" containerID="06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"
Jul 12 16:53:22.663195 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.663180    2577 scope.go:117] "RemoveContainer" containerID="06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"
Jul 12 16:53:22.663442 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:53:22.663422    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9\": container with ID starting with 06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9 not found: ID does not exist" containerID="06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"
Jul 12 16:53:22.663517 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.663452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9"} err="failed to get container status \"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9\": rpc error: code = NotFound desc = could not find container \"06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9\": container with ID starting with 06b4205c56ee83885bdb21435b6a8828b41e66146c3314e5b10655ad343053d9 not found: ID does not exist"
Jul 12 16:53:22.671810 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.671783    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:53:22.675527 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:22.675507    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44bf2bf1-7f64b5f8f5-sf6sw"]
Jul 12 16:53:24.631946 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:24.631861    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" path="/var/lib/kubelet/pods/01d8b601-42fa-4a60-8c7c-dd23e0103ada/volumes"
Jul 12 16:53:32.253353 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:32.253313    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:53:47.274289 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.274229    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" podUID="6327d081-20e2-4afc-8218-c5a58ee2953c" containerName="main" containerID="cri-o://5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb" gracePeriod=45
Jul 12 16:53:47.520987 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.520957    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:47.553793 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4jlx\" (UniqueName: \"kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.553793 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553788    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.554040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553808    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.554040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553845    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.554040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553865    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.554040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.553888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache\") pod \"6327d081-20e2-4afc-8218-c5a58ee2953c\" (UID: \"6327d081-20e2-4afc-8218-c5a58ee2953c\") "
Jul 12 16:53:47.554260 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.554228    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache" (OuterVolumeSpecName: "model-cache") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:53:47.554574 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.554535    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:53:47.554693 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.554673    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home" (OuterVolumeSpecName: "home") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:53:47.556913 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.556885    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm" (OuterVolumeSpecName: "dshm") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:53:47.556913 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.556899    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:53:47.557086 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.556989    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx" (OuterVolumeSpecName: "kube-api-access-p4jlx") pod "6327d081-20e2-4afc-8218-c5a58ee2953c" (UID: "6327d081-20e2-4afc-8218-c5a58ee2953c"). InnerVolumeSpecName "kube-api-access-p4jlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:53:47.654804 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654769    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6327d081-20e2-4afc-8218-c5a58ee2953c-tls-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.654970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654820    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-tmp-dir\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.654970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654829    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-dshm\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.654970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654836    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-home\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.654970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654844    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6327d081-20e2-4afc-8218-c5a58ee2953c-model-cache\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.654970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.654852    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4jlx\" (UniqueName: \"kubernetes.io/projected/6327d081-20e2-4afc-8218-c5a58ee2953c-kube-api-access-p4jlx\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:53:47.758728 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.758693    2577 generic.go:356] "Generic (PLEG): container finished" podID="6327d081-20e2-4afc-8218-c5a58ee2953c" containerID="5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb" exitCode=0
Jul 12 16:53:47.758902 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.758737    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"
Jul 12 16:53:47.758902 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.758747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" event={"ID":"6327d081-20e2-4afc-8218-c5a58ee2953c","Type":"ContainerDied","Data":"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"}
Jul 12 16:53:47.758902 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.758778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd" event={"ID":"6327d081-20e2-4afc-8218-c5a58ee2953c","Type":"ContainerDied","Data":"8b97a458316efd0171d90480c8e8be161e2584dbde0215f5b89fb69d925974a4"}
Jul 12 16:53:47.758902 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.758794    2577 scope.go:117] "RemoveContainer" containerID="5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"
Jul 12 16:53:47.767152 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.767135    2577 scope.go:117] "RemoveContainer" containerID="5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"
Jul 12 16:53:47.767406 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:53:47.767384    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb\": container with ID starting with 5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb not found: ID does not exist" containerID="5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"
Jul 12 16:53:47.767446 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.767416    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb"} err="failed to get container status \"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb\": rpc error: code = NotFound desc = could not find container \"5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb\": container with ID starting with 5f42d81f68b78fbe71a9ae968d2ed6e30dd8300dc9fd270cfb7ad0026a9e9fcb not found: ID does not exist"
Jul 12 16:53:47.778385 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.778359    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:53:47.782060 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:47.782038    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-44bf2bf1/e2e-lifecycle-model-44bf2bf1-kserve-858b896b7-z85rd"]
Jul 12 16:53:48.631339 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:53:48.631304    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6327d081-20e2-4afc-8218-c5a58ee2953c" path="/var/lib/kubelet/pods/6327d081-20e2-4afc-8218-c5a58ee2953c/volumes"
Jul 12 16:55:02.651945 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:02.651905    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:55:02.655040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:02.655018    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 16:55:12.986967 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.986928    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:55:12.987504 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987395    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6327d081-20e2-4afc-8218-c5a58ee2953c" containerName="main"
Jul 12 16:55:12.987504 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987414    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6327d081-20e2-4afc-8218-c5a58ee2953c" containerName="main"
Jul 12 16:55:12.987504 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987430    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" containerName="maas-api"
Jul 12 16:55:12.987504 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987439    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" containerName="maas-api"
Jul 12 16:55:12.987654 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987530    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6327d081-20e2-4afc-8218-c5a58ee2953c" containerName="main"
Jul 12 16:55:12.987654 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.987540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d8b601-42fa-4a60-8c7c-dd23e0103ada" containerName="maas-api"
Jul 12 16:55:12.990184 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.990169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:12.994505 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.994465    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:55:12.994630 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.994532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2aa2dc-serving-cert\""
Jul 12 16:55:12.995402 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.995386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:55:12.995539 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:12.995387    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:55:13.001911 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.001883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:55:13.098462 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.098419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjjr\" (UniqueName: \"kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.098656 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.098519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.098656 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.098555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.199036 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.198993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjjr\" (UniqueName: \"kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.199254 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.199074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.199254 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.199109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.199800 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.199777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.201572 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.201550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.206964 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.206941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjjr\" (UniqueName: \"kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr\") pod \"maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.301756 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.301665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:13.439208 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.439087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:55:13.442069 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:55:13.442045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae807fb_fe1e_4641_a69c_9e27afe237ca.slice/crio-61b4e0d50e6303ed0cb06a1a704ab7439934f9e0b2e8ca4cc1a6ef918412b4d6 WatchSource:0}: Error finding container 61b4e0d50e6303ed0cb06a1a704ab7439934f9e0b2e8ca4cc1a6ef918412b4d6: Status 404 returned error can't find the container with id 61b4e0d50e6303ed0cb06a1a704ab7439934f9e0b2e8ca4cc1a6ef918412b4d6
Jul 12 16:55:13.443721 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:13.443701    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 16:55:14.108967 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:14.108928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" event={"ID":"6ae807fb-fe1e-4641-a69c-9e27afe237ca","Type":"ContainerStarted","Data":"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"}
Jul 12 16:55:14.109430 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:14.109001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" event={"ID":"6ae807fb-fe1e-4641-a69c-9e27afe237ca","Type":"ContainerStarted","Data":"61b4e0d50e6303ed0cb06a1a704ab7439934f9e0b2e8ca4cc1a6ef918412b4d6"}
Jul 12 16:55:14.109430 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:14.109037    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:14.126384 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:14.126243    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" podStartSLOduration=1.704904696 podStartE2EDuration="2.126226487s" totalImagesPullingTime="421.321791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:55:14.124998412 +0000 UTC m=+1811.982891801" watchObservedRunningTime="2026-07-12 16:55:14.126226487 +0000 UTC m=+1811.984119898"
Jul 12 16:55:20.118664 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:20.118633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:55:21.120397 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.120363    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:55:21.123997 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.123974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.126489 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.126456    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c3601d-serving-cert\""
Jul 12 16:55:21.135560 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.135529    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:55:21.159428 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.159401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvq4p\" (UniqueName: \"kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.159586 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.159438    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.159586 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.159462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.260386 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.260348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvq4p\" (UniqueName: \"kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.260386 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.260390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.260657 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.260411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.260657 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:55:21.260610    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-serving-cert: secret "maas-api-e2e-inf-b-c3601d-serving-cert" not found
Jul 12 16:55:21.260764 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:55:21.260692    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls podName:9f0c73f1-d3c7-4fa6-b940-77bc268ad416 nodeName:}" failed. No retries permitted until 2026-07-12 16:55:21.760670261 +0000 UTC m=+1819.618563627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls") pod "maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" (UID: "9f0c73f1-d3c7-4fa6-b940-77bc268ad416") : secret "maas-api-e2e-inf-b-c3601d-serving-cert" not found
Jul 12 16:55:21.261079 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.261060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.269063 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.269038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvq4p\" (UniqueName: \"kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.765058 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.765018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:21.767373 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:21.767345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") pod \"maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:22.035041 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:22.034946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:22.171182 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:22.171158    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:55:22.173504 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:55:22.173456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0c73f1_d3c7_4fa6_b940_77bc268ad416.slice/crio-ae2921d5622c8d7c30d8ddd1fcfdb5136c6666fa5f0b50beb0c7a2fdade1bdd3 WatchSource:0}: Error finding container ae2921d5622c8d7c30d8ddd1fcfdb5136c6666fa5f0b50beb0c7a2fdade1bdd3: Status 404 returned error can't find the container with id ae2921d5622c8d7c30d8ddd1fcfdb5136c6666fa5f0b50beb0c7a2fdade1bdd3
Jul 12 16:55:23.148998 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:23.148964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" event={"ID":"9f0c73f1-d3c7-4fa6-b940-77bc268ad416","Type":"ContainerStarted","Data":"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"}
Jul 12 16:55:23.149180 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:23.149021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" event={"ID":"9f0c73f1-d3c7-4fa6-b940-77bc268ad416","Type":"ContainerStarted","Data":"ae2921d5622c8d7c30d8ddd1fcfdb5136c6666fa5f0b50beb0c7a2fdade1bdd3"}
Jul 12 16:55:23.149180 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:23.149097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:29.159362 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:29.159332    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:55:29.176705 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:29.176655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" podStartSLOduration=7.842174335 podStartE2EDuration="8.176639547s" totalImagesPullingTime="334.465212ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:55:23.16442973 +0000 UTC m=+1821.022323117" watchObservedRunningTime="2026-07-12 16:55:29.176639547 +0000 UTC m=+1827.034532934"
Jul 12 16:55:32.171648 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.171618    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:55:32.175136 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.175115    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.178851 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.178820    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2aa2dc\"/\"default-dockercfg-k2hs4\""
Jul 12 16:55:32.178851 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.178846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2aa2dc\"/\"openshift-service-ca.crt\""
Jul 12 16:55:32.179017 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.178828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2aa2dc\"/\"test-model-2aa2dc-kserve-self-signed-certs\""
Jul 12 16:55:32.184939 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.179277    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2aa2dc\"/\"kube-root-ca.crt\""
Jul 12 16:55:32.190733 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.190706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:55:32.250531 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.250724 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.250724 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqpcg\" (UniqueName: \"kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.250724 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.250724 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.250881 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.250739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352017 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.351977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352017 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352265 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352265 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352265 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352422 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqpcg\" (UniqueName: \"kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352541 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352602 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.352648 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.352610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.354303 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.354282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.354500 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.354457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.382007 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.381976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqpcg\" (UniqueName: \"kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg\") pod \"test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") " pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.499659 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.499556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:32.632814 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:32.632782    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:55:32.636460 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:55:32.636431    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabc23799_47e9_4737_b197_f183400abcd9.slice/crio-c9ca773c380c7f90f4f58dace8470a3bb2fb6986b50edb6caaf9470a79471275 WatchSource:0}: Error finding container c9ca773c380c7f90f4f58dace8470a3bb2fb6986b50edb6caaf9470a79471275: Status 404 returned error can't find the container with id c9ca773c380c7f90f4f58dace8470a3bb2fb6986b50edb6caaf9470a79471275
Jul 12 16:55:33.194152 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:33.194112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" event={"ID":"abc23799-47e9-4737-b197-f183400abcd9","Type":"ContainerStarted","Data":"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"}
Jul 12 16:55:33.194568 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:33.194163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" event={"ID":"abc23799-47e9-4737-b197-f183400abcd9","Type":"ContainerStarted","Data":"c9ca773c380c7f90f4f58dace8470a3bb2fb6986b50edb6caaf9470a79471275"}
Jul 12 16:55:33.210897 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:33.210842    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" podStartSLOduration=1.210825708 podStartE2EDuration="1.210825708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:55:33.209094673 +0000 UTC m=+1831.066988063" watchObservedRunningTime="2026-07-12 16:55:33.210825708 +0000 UTC m=+1831.068719094"
Jul 12 16:55:42.500604 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:42.500562    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:42.500604 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:42.500612    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:42.513833 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:42.513807    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:55:43.248640 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:55:43.248613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:56:01.465316 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.465280    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:01.469509 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.469470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.473565 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.473532    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c3601d\"/\"test-model-c3601d-kserve-self-signed-certs\""
Jul 12 16:56:01.473698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.473560    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c3601d\"/\"openshift-service-ca.crt\""
Jul 12 16:56:01.473698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.473580    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c3601d\"/\"kube-root-ca.crt\""
Jul 12 16:56:01.473698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.473655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c3601d\"/\"default-dockercfg-qrqmr\""
Jul 12 16:56:01.481017 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.480988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:01.618657 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.618609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.618968 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.618930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.619132 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.619108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.619324 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.619222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.619324 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.619274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.619324 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.619299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66z8\" (UniqueName: \"kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.720901 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.720901 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.720901 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66z8\" (UniqueName: \"kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.720901 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.721227 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.721227 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.720949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.721318 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.721272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.721380 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.721323    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.721434 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.721392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.723166 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.723143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.723414 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.723398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.728895 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.728863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66z8\" (UniqueName: \"kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8\") pod \"test-model-c3601d-kserve-c6596f5ff-k2jlh\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") " pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.784912 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.784872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:01.921144 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:01.921111    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:01.925115 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:56:01.925087    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ffcec04_68be_4b39_a73f_3e5cbb3d5210.slice/crio-6e3c654b2ad8798c6a7653fb0c11032d8ff63109d39620a0dbdfa6db60b8da67 WatchSource:0}: Error finding container 6e3c654b2ad8798c6a7653fb0c11032d8ff63109d39620a0dbdfa6db60b8da67: Status 404 returned error can't find the container with id 6e3c654b2ad8798c6a7653fb0c11032d8ff63109d39620a0dbdfa6db60b8da67
Jul 12 16:56:02.318717 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:02.318625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" event={"ID":"8ffcec04-68be-4b39-a73f-3e5cbb3d5210","Type":"ContainerStarted","Data":"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"}
Jul 12 16:56:02.318717 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:02.318667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" event={"ID":"8ffcec04-68be-4b39-a73f-3e5cbb3d5210","Type":"ContainerStarted","Data":"6e3c654b2ad8798c6a7653fb0c11032d8ff63109d39620a0dbdfa6db60b8da67"}
Jul 12 16:56:02.335938 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:02.335876    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" podStartSLOduration=1.335854738 podStartE2EDuration="1.335854738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:56:02.334564832 +0000 UTC m=+1860.192458214" watchObservedRunningTime="2026-07-12 16:56:02.335854738 +0000 UTC m=+1860.193748129"
Jul 12 16:56:11.785282 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:11.785240    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:11.785706 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:11.785300    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:11.797778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:11.797753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:12.375419 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:12.375379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:24.031112 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:24.031059    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:56:25.067375 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:25.067335    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:26.061773 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.061742    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:56:26.062010 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.061961    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" podUID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" containerName="maas-api" containerID="cri-o://d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536" gracePeriod=30
Jul 12 16:56:26.306579 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.306553    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:56:26.426685 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.426646    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" containerID="d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536" exitCode=0
Jul 12 16:56:26.426869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.426696    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"
Jul 12 16:56:26.426869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.426712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" event={"ID":"6ae807fb-fe1e-4641-a69c-9e27afe237ca","Type":"ContainerDied","Data":"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"}
Jul 12 16:56:26.426869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.426764    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc" event={"ID":"6ae807fb-fe1e-4641-a69c-9e27afe237ca","Type":"ContainerDied","Data":"61b4e0d50e6303ed0cb06a1a704ab7439934f9e0b2e8ca4cc1a6ef918412b4d6"}
Jul 12 16:56:26.426869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.426792    2577 scope.go:117] "RemoveContainer" containerID="d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"
Jul 12 16:56:26.435122 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.435098    2577 scope.go:117] "RemoveContainer" containerID="d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"
Jul 12 16:56:26.435373 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:56:26.435353    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536\": container with ID starting with d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536 not found: ID does not exist" containerID="d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"
Jul 12 16:56:26.435444 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.435382    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536"} err="failed to get container status \"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536\": rpc error: code = NotFound desc = could not find container \"d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536\": container with ID starting with d295330d21ab3ab709bfc5bcdae927488c5b60e276470492d43c10fb7cac2536 not found: ID does not exist"
Jul 12 16:56:26.442701 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.442682    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcjjr\" (UniqueName: \"kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr\") pod \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") "
Jul 12 16:56:26.442799 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.442784    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls\") pod \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") "
Jul 12 16:56:26.442848 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.442834    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca\") pod \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\" (UID: \"6ae807fb-fe1e-4641-a69c-9e27afe237ca\") "
Jul 12 16:56:26.443224 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.443197    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ae807fb-fe1e-4641-a69c-9e27afe237ca" (UID: "6ae807fb-fe1e-4641-a69c-9e27afe237ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:56:26.444811 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.444786    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ae807fb-fe1e-4641-a69c-9e27afe237ca" (UID: "6ae807fb-fe1e-4641-a69c-9e27afe237ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:56:26.444899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.444808    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr" (OuterVolumeSpecName: "kube-api-access-hcjjr") pod "6ae807fb-fe1e-4641-a69c-9e27afe237ca" (UID: "6ae807fb-fe1e-4641-a69c-9e27afe237ca"). InnerVolumeSpecName "kube-api-access-hcjjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:56:26.543671 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.543632    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcjjr\" (UniqueName: \"kubernetes.io/projected/6ae807fb-fe1e-4641-a69c-9e27afe237ca-kube-api-access-hcjjr\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:26.543671 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.543663    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ae807fb-fe1e-4641-a69c-9e27afe237ca-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:26.543671 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.543672    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ae807fb-fe1e-4641-a69c-9e27afe237ca-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:26.744346 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.744257    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:56:26.747916 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:26.747883    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2aa2dc-7bbc9b5fb9-rf9nc"]
Jul 12 16:56:28.634391 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:28.634360    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" path="/var/lib/kubelet/pods/6ae807fb-fe1e-4641-a69c-9e27afe237ca/volumes"
Jul 12 16:56:39.051088 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.051039    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" podUID="abc23799-47e9-4737-b197-f183400abcd9" containerName="main" containerID="cri-o://ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9" gracePeriod=45
Jul 12 16:56:39.297730 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.297699    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:56:39.462575 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462540    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.462575 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462577    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.462823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqpcg\" (UniqueName: \"kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.462823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.462823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462678    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.462823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462726    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home\") pod \"abc23799-47e9-4737-b197-f183400abcd9\" (UID: \"abc23799-47e9-4737-b197-f183400abcd9\") "
Jul 12 16:56:39.463028 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.462986    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:39.463028 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.463000    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:39.463121 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.463061    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home" (OuterVolumeSpecName: "home") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:39.464867 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.464838    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm" (OuterVolumeSpecName: "dshm") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:39.464965 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.464890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:56:39.464965 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.464901    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg" (OuterVolumeSpecName: "kube-api-access-jqpcg") pod "abc23799-47e9-4737-b197-f183400abcd9" (UID: "abc23799-47e9-4737-b197-f183400abcd9"). InnerVolumeSpecName "kube-api-access-jqpcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:56:39.485460 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.485430    2577 generic.go:356] "Generic (PLEG): container finished" podID="abc23799-47e9-4737-b197-f183400abcd9" containerID="ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9" exitCode=0
Jul 12 16:56:39.485615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.485472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" event={"ID":"abc23799-47e9-4737-b197-f183400abcd9","Type":"ContainerDied","Data":"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"}
Jul 12 16:56:39.485615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.485496    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"
Jul 12 16:56:39.485615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.485516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw" event={"ID":"abc23799-47e9-4737-b197-f183400abcd9","Type":"ContainerDied","Data":"c9ca773c380c7f90f4f58dace8470a3bb2fb6986b50edb6caaf9470a79471275"}
Jul 12 16:56:39.485615 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.485532    2577 scope.go:117] "RemoveContainer" containerID="ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"
Jul 12 16:56:39.493869 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.493851    2577 scope.go:117] "RemoveContainer" containerID="ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"
Jul 12 16:56:39.494124 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:56:39.494106    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9\": container with ID starting with ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9 not found: ID does not exist" containerID="ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"
Jul 12 16:56:39.494187 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.494130    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9"} err="failed to get container status \"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9\": rpc error: code = NotFound desc = could not find container \"ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9\": container with ID starting with ea93c6529dd9b9f112ba3e6bdffda4159d1c62954590babd41901b1b2ab7bba9 not found: ID does not exist"
Jul 12 16:56:39.505331 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.505299    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:56:39.509048 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.509018    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2aa2dc/test-model-2aa2dc-kserve-55c5bd6f5f-k2xvw"]
Jul 12 16:56:39.564039 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564003    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-dshm\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:39.564039 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564035    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abc23799-47e9-4737-b197-f183400abcd9-tls-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:39.564211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564047    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqpcg\" (UniqueName: \"kubernetes.io/projected/abc23799-47e9-4737-b197-f183400abcd9-kube-api-access-jqpcg\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:39.564211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564059    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-tmp-dir\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:39.564211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564075    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-model-cache\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:39.564211 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:39.564085    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abc23799-47e9-4737-b197-f183400abcd9-home\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.087444 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.087398    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" podUID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" containerName="main" containerID="cri-o://258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6" gracePeriod=45
Jul 12 16:56:40.342738 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.342678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:40.473421 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473388    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k66z8\" (UniqueName: \"kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473590 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473454    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473590 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473590 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473526    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473590 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473557    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473605    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir\") pod \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\" (UID: \"8ffcec04-68be-4b39-a73f-3e5cbb3d5210\") "
Jul 12 16:56:40.473823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473717    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home" (OuterVolumeSpecName: "home") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:40.473823 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473793    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:40.473973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473887    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-home\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.473973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.473902    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-model-cache\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.474085 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.474003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:40.475661 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.475636    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm" (OuterVolumeSpecName: "dshm") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:56:40.475755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.475726    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:56:40.475755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.475729    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8" (OuterVolumeSpecName: "kube-api-access-k66z8") pod "8ffcec04-68be-4b39-a73f-3e5cbb3d5210" (UID: "8ffcec04-68be-4b39-a73f-3e5cbb3d5210"). InnerVolumeSpecName "kube-api-access-k66z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:56:40.492028 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.492001    2577 generic.go:356] "Generic (PLEG): container finished" podID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" containerID="258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6" exitCode=0
Jul 12 16:56:40.492145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.492041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" event={"ID":"8ffcec04-68be-4b39-a73f-3e5cbb3d5210","Type":"ContainerDied","Data":"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"}
Jul 12 16:56:40.492145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.492047    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"
Jul 12 16:56:40.492145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.492072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh" event={"ID":"8ffcec04-68be-4b39-a73f-3e5cbb3d5210","Type":"ContainerDied","Data":"6e3c654b2ad8798c6a7653fb0c11032d8ff63109d39620a0dbdfa6db60b8da67"}
Jul 12 16:56:40.492145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.492089    2577 scope.go:117] "RemoveContainer" containerID="258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"
Jul 12 16:56:40.500832 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.500815    2577 scope.go:117] "RemoveContainer" containerID="258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"
Jul 12 16:56:40.501089 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:56:40.501071    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6\": container with ID starting with 258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6 not found: ID does not exist" containerID="258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"
Jul 12 16:56:40.501150 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.501103    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6"} err="failed to get container status \"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6\": rpc error: code = NotFound desc = could not find container \"258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6\": container with ID starting with 258f910809bebee1b65cef942a8921e4b1c6a6a1e1bda9265afff80321fa38d6 not found: ID does not exist"
Jul 12 16:56:40.512214 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.512189    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:40.516105 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.516081    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c3601d/test-model-c3601d-kserve-c6596f5ff-k2jlh"]
Jul 12 16:56:40.574835 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.574806    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k66z8\" (UniqueName: \"kubernetes.io/projected/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-kube-api-access-k66z8\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.574835 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.574834    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tls-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.574835 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.574845    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-dshm\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.575024 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.574853    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ffcec04-68be-4b39-a73f-3e5cbb3d5210-tmp-dir\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:56:40.636985 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.636898    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" path="/var/lib/kubelet/pods/8ffcec04-68be-4b39-a73f-3e5cbb3d5210/volumes"
Jul 12 16:56:40.637302 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:56:40.637289    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc23799-47e9-4737-b197-f183400abcd9" path="/var/lib/kubelet/pods/abc23799-47e9-4737-b197-f183400abcd9/volumes"
Jul 12 16:57:09.121546 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.121508    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:57:09.122045 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.121775    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerName="maas-api" containerID="cri-o://671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2" gracePeriod=30
Jul 12 16:57:09.154490 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.154444    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.26:8443/health\": dial tcp 10.134.0.26:8443: connect: connection refused"
Jul 12 16:57:09.566822 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.566793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:57:09.604789 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.604748    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvq4p\" (UniqueName: \"kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p\") pod \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") "
Jul 12 16:57:09.604972 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.604840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca\") pod \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") "
Jul 12 16:57:09.604972 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.604940    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") pod \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\" (UID: \"9f0c73f1-d3c7-4fa6-b940-77bc268ad416\") "
Jul 12 16:57:09.605232 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.605202    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f0c73f1-d3c7-4fa6-b940-77bc268ad416" (UID: "9f0c73f1-d3c7-4fa6-b940-77bc268ad416"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:57:09.607040 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.607013    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f0c73f1-d3c7-4fa6-b940-77bc268ad416" (UID: "9f0c73f1-d3c7-4fa6-b940-77bc268ad416"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:57:09.607140 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.607098    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p" (OuterVolumeSpecName: "kube-api-access-nvq4p") pod "9f0c73f1-d3c7-4fa6-b940-77bc268ad416" (UID: "9f0c73f1-d3c7-4fa6-b940-77bc268ad416"). InnerVolumeSpecName "kube-api-access-nvq4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:57:09.618668 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.618637    2577 generic.go:356] "Generic (PLEG): container finished" podID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerID="671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2" exitCode=0
Jul 12 16:57:09.618778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.618673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" event={"ID":"9f0c73f1-d3c7-4fa6-b940-77bc268ad416","Type":"ContainerDied","Data":"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"}
Jul 12 16:57:09.618778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.618682    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"
Jul 12 16:57:09.618778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.618715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z" event={"ID":"9f0c73f1-d3c7-4fa6-b940-77bc268ad416","Type":"ContainerDied","Data":"ae2921d5622c8d7c30d8ddd1fcfdb5136c6666fa5f0b50beb0c7a2fdade1bdd3"}
Jul 12 16:57:09.618778 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.618736    2577 scope.go:117] "RemoveContainer" containerID="671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"
Jul 12 16:57:09.627333 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.627317    2577 scope.go:117] "RemoveContainer" containerID="671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"
Jul 12 16:57:09.627647 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:09.627625    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2\": container with ID starting with 671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2 not found: ID does not exist" containerID="671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"
Jul 12 16:57:09.627739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.627652    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2"} err="failed to get container status \"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2\": rpc error: code = NotFound desc = could not find container \"671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2\": container with ID starting with 671eea6c9ea8d05d8e046029ec43f7594add0e37f0295a9e1d8aec569ac862d2 not found: ID does not exist"
Jul 12 16:57:09.640587 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.640558    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:57:09.645274 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.645247    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c3601d-79f5475b8d-cr44z"]
Jul 12 16:57:09.705658 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.705579    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:09.705658 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.705605    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvq4p\" (UniqueName: \"kubernetes.io/projected/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-kube-api-access-nvq4p\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:09.705658 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:09.705615    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f0c73f1-d3c7-4fa6-b940-77bc268ad416-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:10.630945 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:10.630910    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" path="/var/lib/kubelet/pods/9f0c73f1-d3c7-4fa6-b940-77bc268ad416/volumes"
Jul 12 16:57:15.654527 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.654490    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:15.655009 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.654986    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" containerName="maas-api"
Jul 12 16:57:15.655174 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655161    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" containerName="maas-api"
Jul 12 16:57:15.655276 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655266    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc23799-47e9-4737-b197-f183400abcd9" containerName="main"
Jul 12 16:57:15.655361 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655343    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc23799-47e9-4737-b197-f183400abcd9" containerName="main"
Jul 12 16:57:15.655455 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655364    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerName="maas-api"
Jul 12 16:57:15.655455 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655373    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerName="maas-api"
Jul 12 16:57:15.655455 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655391    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" containerName="main"
Jul 12 16:57:15.655455 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655400    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" containerName="main"
Jul 12 16:57:15.655619 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655504    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f0c73f1-d3c7-4fa6-b940-77bc268ad416" containerName="maas-api"
Jul 12 16:57:15.655619 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655520    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc23799-47e9-4737-b197-f183400abcd9" containerName="main"
Jul 12 16:57:15.655619 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655529    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ffcec04-68be-4b39-a73f-3e5cbb3d5210" containerName="main"
Jul 12 16:57:15.655619 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.655542    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae807fb-fe1e-4641-a69c-9e27afe237ca" containerName="maas-api"
Jul 12 16:57:15.660226 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.660204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.662709 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.662684    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f795ff-openshift-default-dockercfg-x6cn8\""
Jul 12 16:57:15.669769 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.669747    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:15.763077 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763244 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763244 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5zh\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763244 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763521 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763521 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763521 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763521 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.763656 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.763541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864395 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864395 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864686 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5zh\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864686 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864686 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864686 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.864863 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.865020 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.864901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.865098 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.865069    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.865098 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.865076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.865190 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.865167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.865890 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.865867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.866937 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.866913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.867031 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.866957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.873057 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.872997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.873177 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.873140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5zh\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh\") pod \"e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") " pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:15.970430 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:15.970337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:16.105538 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:16.105506    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:16.108079 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:57:16.108051    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cf2682_7496_4ab6_a650_c7a025f1c88d.slice/crio-8757b2d8144c1e489de7575341c5059fa2b243eb9841606cb7482a69dd3b52ae WatchSource:0}: Error finding container 8757b2d8144c1e489de7575341c5059fa2b243eb9841606cb7482a69dd3b52ae: Status 404 returned error can't find the container with id 8757b2d8144c1e489de7575341c5059fa2b243eb9841606cb7482a69dd3b52ae
Jul 12 16:57:16.648037 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:16.648000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerStarted","Data":"8757b2d8144c1e489de7575341c5059fa2b243eb9841606cb7482a69dd3b52ae"}
Jul 12 16:57:18.681613 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:18.681575    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:18.681922 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:18.681645    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:18.681922 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:18.681675    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:19.662698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:19.662663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerStarted","Data":"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"}
Jul 12 16:57:19.682903 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:19.682838    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podStartSLOduration=2.111565883 podStartE2EDuration="4.682818635s" totalImagesPullingTime="2.571252752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:57:19.681812106 +0000 UTC m=+1937.539705493" watchObservedRunningTime="2026-07-12 16:57:19.682818635 +0000 UTC m=+1937.540712023"
Jul 12 16:57:19.970759 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:19.970674    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:19.975658 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:19.975624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:20.666846 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:20.666817    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:20.667739 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:20.667722    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:21.751437 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.751387    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:21.754732 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.754715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.757904 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.757882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f795ff-serving-cert\""
Jul 12 16:57:21.758215 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.758198    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:57:21.758916 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.758896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:57:21.758982 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.758905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:57:21.785711 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.785673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:21.819683 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.819648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.819862 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.819730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6bw\" (UniqueName: \"kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.819862 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.819799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.920690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.920656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.920876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.920707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6bw\" (UniqueName: \"kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.920876 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.920728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.921041 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:21.920882    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-serving-cert: secret "maas-api-e2e-api-a-f795ff-serving-cert" not found
Jul 12 16:57:21.921041 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:21.920953    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls podName:0eba1f32-4083-440c-a644-7223152a686d nodeName:}" failed. No retries permitted until 2026-07-12 16:57:22.420938845 +0000 UTC m=+1940.278832210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls") pod "maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" (UID: "0eba1f32-4083-440c-a644-7223152a686d") : secret "maas-api-e2e-api-a-f795ff-serving-cert" not found
Jul 12 16:57:21.921360 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.921341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:21.935286 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:21.935249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6bw\" (UniqueName: \"kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:22.425202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:22.425160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:22.427804 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:22.427775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") pod \"maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:22.665300 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:22.665255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:22.799730 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:22.799703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:22.802245 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:57:22.802213    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eba1f32_4083_440c_a644_7223152a686d.slice/crio-cea8ecb5dddfd50fcd1b7b437eef918e9fbdec72e864a7ea79e2ed491fa74d6a WatchSource:0}: Error finding container cea8ecb5dddfd50fcd1b7b437eef918e9fbdec72e864a7ea79e2ed491fa74d6a: Status 404 returned error can't find the container with id cea8ecb5dddfd50fcd1b7b437eef918e9fbdec72e864a7ea79e2ed491fa74d6a
Jul 12 16:57:23.681451 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:23.681414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" event={"ID":"0eba1f32-4083-440c-a644-7223152a686d","Type":"ContainerStarted","Data":"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"}
Jul 12 16:57:23.681649 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:23.681467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" event={"ID":"0eba1f32-4083-440c-a644-7223152a686d","Type":"ContainerStarted","Data":"cea8ecb5dddfd50fcd1b7b437eef918e9fbdec72e864a7ea79e2ed491fa74d6a"}
Jul 12 16:57:23.681649 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:23.681514    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:23.697910 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:23.697858    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" podStartSLOduration=2.290020303 podStartE2EDuration="2.697841503s" totalImagesPullingTime="407.8212ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:57:23.697198188 +0000 UTC m=+1941.555091576" watchObservedRunningTime="2026-07-12 16:57:23.697841503 +0000 UTC m=+1941.555734889"
Jul 12 16:57:29.700503 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:29.698032    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:33.734540 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.734504    2577 generic.go:356] "Generic (PLEG): container finished" podID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerID="5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a" exitCode=0
Jul 12 16:57:33.734540 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.734505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerDied","Data":"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"}
Jul 12 16:57:33.735141 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.735021    2577 scope.go:117] "RemoveContainer" containerID="5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"
Jul 12 16:57:33.736090 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.736060    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:33.736165 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.736133    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:33.736202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:33.736165    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:34.741291 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:34.741255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerStarted","Data":"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"}
Jul 12 16:57:34.970801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:34.970754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:34.971971 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:34.971934    2577 patch_prober.go:28] interesting pod/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 12 16:57:34.972088 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:34.971996    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 12 16:57:35.667460 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:35.667423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:35.971284 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:35.971187    2577 patch_prober.go:28] interesting pod/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 12 16:57:35.971284 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:35.971249    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 12 16:57:36.971636 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:36.971597    2577 patch_prober.go:28] interesting pod/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 12 16:57:36.972055 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:36.971654    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 12 16:57:37.970896 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:37.970859    2577 patch_prober.go:28] interesting pod/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 12 16:57:37.971107 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:37.970935    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 12 16:57:38.976272 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:38.976235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:38.977386 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:38.977369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:42.881593 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:42.881559    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:42.882231 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:42.881788    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" podUID="0eba1f32-4083-440c-a644-7223152a686d" containerName="maas-api" containerID="cri-o://e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c" gracePeriod=30
Jul 12 16:57:43.127564 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.127538    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:43.221690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.221589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca\") pod \"0eba1f32-4083-440c-a644-7223152a686d\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") "
Jul 12 16:57:43.221690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.221634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") pod \"0eba1f32-4083-440c-a644-7223152a686d\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") "
Jul 12 16:57:43.221914 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.221724    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb6bw\" (UniqueName: \"kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw\") pod \"0eba1f32-4083-440c-a644-7223152a686d\" (UID: \"0eba1f32-4083-440c-a644-7223152a686d\") "
Jul 12 16:57:43.222063 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.222034    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0eba1f32-4083-440c-a644-7223152a686d" (UID: "0eba1f32-4083-440c-a644-7223152a686d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:57:43.223868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.223841    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0eba1f32-4083-440c-a644-7223152a686d" (UID: "0eba1f32-4083-440c-a644-7223152a686d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 16:57:43.223981 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.223844    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw" (OuterVolumeSpecName: "kube-api-access-nb6bw") pod "0eba1f32-4083-440c-a644-7223152a686d" (UID: "0eba1f32-4083-440c-a644-7223152a686d"). InnerVolumeSpecName "kube-api-access-nb6bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:57:43.322344 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.322305    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb6bw\" (UniqueName: \"kubernetes.io/projected/0eba1f32-4083-440c-a644-7223152a686d-kube-api-access-nb6bw\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:43.322344 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.322338    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0eba1f32-4083-440c-a644-7223152a686d-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:43.322344 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.322352    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0eba1f32-4083-440c-a644-7223152a686d-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:43.780854 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.780817    2577 generic.go:356] "Generic (PLEG): container finished" podID="0eba1f32-4083-440c-a644-7223152a686d" containerID="e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c" exitCode=0
Jul 12 16:57:43.780854 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.780858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" event={"ID":"0eba1f32-4083-440c-a644-7223152a686d","Type":"ContainerDied","Data":"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"}
Jul 12 16:57:43.781082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.780903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7" event={"ID":"0eba1f32-4083-440c-a644-7223152a686d","Type":"ContainerDied","Data":"cea8ecb5dddfd50fcd1b7b437eef918e9fbdec72e864a7ea79e2ed491fa74d6a"}
Jul 12 16:57:43.781082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.780863    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"
Jul 12 16:57:43.781082 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.780930    2577 scope.go:117] "RemoveContainer" containerID="e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"
Jul 12 16:57:43.790004 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.789984    2577 scope.go:117] "RemoveContainer" containerID="e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"
Jul 12 16:57:43.790257 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:43.790238    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c\": container with ID starting with e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c not found: ID does not exist" containerID="e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"
Jul 12 16:57:43.790322 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.790263    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c"} err="failed to get container status \"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c\": rpc error: code = NotFound desc = could not find container \"e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c\": container with ID starting with e8d7024f73139ffa25135d6e237e4ec0c151b3baf0326e97204e00a53889992c not found: ID does not exist"
Jul 12 16:57:43.802340 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.802310    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:43.806230 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:43.806209    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f795ff-576bdd5598-8g7b7"]
Jul 12 16:57:44.632657 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:44.632625    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eba1f32-4083-440c-a644-7223152a686d" path="/var/lib/kubelet/pods/0eba1f32-4083-440c-a644-7223152a686d/volumes"
Jul 12 16:57:48.896387 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:48.896350    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:48.896857 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:48.896587    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" containerID="cri-o://86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283" gracePeriod=30
Jul 12 16:57:53.978549 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:53.978507    2577 patch_prober.go:28] interesting pod/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Jul 12 16:57:53.978929 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:53.978585    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Jul 12 16:57:54.153860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.153834    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:54.218109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.217994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218063    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c5zh\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218109 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218109    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218185    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo\") pod \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\" (UID: \"c0cf2682-7496-4ab6-a650-c7a025f1c88d\") "
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218319    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:57:54.218508 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218420    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218585    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218582    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218673    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-credential-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218693    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218707    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-workload-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.218879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.218721    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istiod-ca-cert\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.219133 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.219094    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:57:54.220464 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.220438    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 16:57:54.220608 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.220454    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 16:57:54.220738 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.220721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:57:54.220860 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.220839    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh" (OuterVolumeSpecName: "kube-api-access-9c5zh") pod "c0cf2682-7496-4ab6-a650-c7a025f1c88d" (UID: "c0cf2682-7496-4ab6-a650-c7a025f1c88d"). InnerVolumeSpecName "kube-api-access-9c5zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 16:57:54.319202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.319162    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-envoy\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.319202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.319194    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c5zh\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-kube-api-access-9c5zh\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.319202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.319204    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-data\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.319202 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.319212    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-token\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.319453 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.319220    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0cf2682-7496-4ab6-a650-c7a025f1c88d-istio-podinfo\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 16:57:54.830810 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.830770    2577 generic.go:356] "Generic (PLEG): container finished" podID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerID="86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283" exitCode=0
Jul 12 16:57:54.830973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.830819    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"
Jul 12 16:57:54.830973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.830854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerDied","Data":"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"}
Jul 12 16:57:54.830973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.830914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd" event={"ID":"c0cf2682-7496-4ab6-a650-c7a025f1c88d","Type":"ContainerDied","Data":"8757b2d8144c1e489de7575341c5059fa2b243eb9841606cb7482a69dd3b52ae"}
Jul 12 16:57:54.830973 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.830938    2577 scope.go:117] "RemoveContainer" containerID="86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"
Jul 12 16:57:54.839220 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.839203    2577 scope.go:117] "RemoveContainer" containerID="5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"
Jul 12 16:57:54.847345 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.847319    2577 scope.go:117] "RemoveContainer" containerID="86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"
Jul 12 16:57:54.847691 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:54.847673    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283\": container with ID starting with 86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283 not found: ID does not exist" containerID="86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"
Jul 12 16:57:54.847745 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.847701    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283"} err="failed to get container status \"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283\": rpc error: code = NotFound desc = could not find container \"86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283\": container with ID starting with 86ca98a32653debf4eb94a4238cd861471d11dcedc740a1ffd223874458dd283 not found: ID does not exist"
Jul 12 16:57:54.847745 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.847718    2577 scope.go:117] "RemoveContainer" containerID="5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"
Jul 12 16:57:54.847975 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:54.847951    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a\": container with ID starting with 5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a not found: ID does not exist" containerID="5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"
Jul 12 16:57:54.848011 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.847980    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a"} err="failed to get container status \"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a\": rpc error: code = NotFound desc = could not find container \"5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a\": container with ID starting with 5e8d4da334d79d3517dedaa15936d7efbeba3c71d319bfef64ad582de9fab31a not found: ID does not exist"
Jul 12 16:57:54.848559 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.848538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:54.852714 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:54.852695    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f795ff-openshift-default-77cdc8db85-jxwxd"]
Jul 12 16:57:56.618401 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618367    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618685    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618696    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618711    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618716    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618733    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eba1f32-4083-440c-a644-7223152a686d" containerName="maas-api"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618740    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eba1f32-4083-440c-a644-7223152a686d" containerName="maas-api"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618785    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eba1f32-4083-440c-a644-7223152a686d" containerName="maas-api"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618792    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.618812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.618798    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" containerName="istio-proxy"
Jul 12 16:57:56.623566 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.623544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.625812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.625793    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-17d27e-openshift-default-dockercfg-4hkwf\""
Jul 12 16:57:56.633949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.633921    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0cf2682-7496-4ab6-a650-c7a025f1c88d" path="/var/lib/kubelet/pods/c0cf2682-7496-4ab6-a650-c7a025f1c88d/volumes"
Jul 12 16:57:56.634518 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.634490    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 16:57:56.739649 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739649 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9ch\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.739868 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.740060 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.739913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841267 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841462 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841462 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9ch\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841614 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841614 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841614 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.841768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.842060 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.841871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.842369 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.842348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.843843 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.843823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.843981 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.843964    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.849518 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.849495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.850044 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.850020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9ch\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch\") pod \"e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") " pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:56.935233 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:56.935147    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:57.076043 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.076015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 16:57:57.078509 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:57:57.078465    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode11fe2eb_692a_4ba0_82dc_0bf20ad549d7.slice/crio-1d784e6cfe1a635bd630397c8f0caa961d6a267122097798564207e4db788764 WatchSource:0}: Error finding container 1d784e6cfe1a635bd630397c8f0caa961d6a267122097798564207e4db788764: Status 404 returned error can't find the container with id 1d784e6cfe1a635bd630397c8f0caa961d6a267122097798564207e4db788764
Jul 12 16:57:57.080648 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.080612    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:57.080744 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.080676    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:57.080744 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.080709    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:57:57.846268 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.846223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerStarted","Data":"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"}
Jul 12 16:57:57.846691 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.846287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerStarted","Data":"1d784e6cfe1a635bd630397c8f0caa961d6a267122097798564207e4db788764"}
Jul 12 16:57:57.867241 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.867144    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podStartSLOduration=1.867125976 podStartE2EDuration="1.867125976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:57:57.865125913 +0000 UTC m=+1975.723019299" watchObservedRunningTime="2026-07-12 16:57:57.867125976 +0000 UTC m=+1975.725019362"
Jul 12 16:57:57.936194 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:57.936159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:58.940899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:58.940861    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:59.823220 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.823186    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 16:57:59.826710 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.826687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.829416 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.829391    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-17d27e-serving-cert\""
Jul 12 16:57:59.829557 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.829395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 16:57:59.830441 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.830423    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-22qm6\""
Jul 12 16:57:59.830546 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.830423    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 16:57:59.839443 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.839417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 16:57:59.855542 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.855516    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:59.856579 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.856555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:57:59.873717 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.873691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9vhr\" (UniqueName: \"kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.873850 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.873724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.873850 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.873750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.975281 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.975238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9vhr\" (UniqueName: \"kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.975801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.975376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.975801 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.975414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.975801 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:59.975552    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-serving-cert: secret "maas-api-e2e-shared-a-17d27e-serving-cert" not found
Jul 12 16:57:59.975801 ip-10-0-132-101 kubenswrapper[2577]: E0712 16:57:59.975625    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls podName:b08c5a99-a7c4-4b0b-926a-79bbadfc89d0 nodeName:}" failed. No retries permitted until 2026-07-12 16:58:00.475605451 +0000 UTC m=+1978.333498826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls") pod "maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" (UID: "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0") : secret "maas-api-e2e-shared-a-17d27e-serving-cert" not found
Jul 12 16:57:59.976141 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.976121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:57:59.985604 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:57:59.985576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9vhr\" (UniqueName: \"kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:00.480690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:00.480644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:00.483169 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:00.483141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") pod \"maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:00.737989 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:00.737884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:00.872177 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:00.872155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 16:58:00.874505 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:58:00.874398    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08c5a99_a7c4_4b0b_926a_79bbadfc89d0.slice/crio-6016fa78e0c33923fb327252f06c075af9145ebb67c92b281ea19b61e7f667db WatchSource:0}: Error finding container 6016fa78e0c33923fb327252f06c075af9145ebb67c92b281ea19b61e7f667db: Status 404 returned error can't find the container with id 6016fa78e0c33923fb327252f06c075af9145ebb67c92b281ea19b61e7f667db
Jul 12 16:58:01.869720 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:01.869683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" event={"ID":"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0","Type":"ContainerStarted","Data":"2466b160a1ed91645f3c3998bdedbb3c4bf6cc36ed2dec5cf13726bda3de5516"}
Jul 12 16:58:01.870163 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:01.869743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" event={"ID":"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0","Type":"ContainerStarted","Data":"6016fa78e0c33923fb327252f06c075af9145ebb67c92b281ea19b61e7f667db"}
Jul 12 16:58:01.870163 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:01.869928    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:01.885499 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:01.885427    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" podStartSLOduration=2.5021316540000003 podStartE2EDuration="2.885409553s" totalImagesPullingTime="383.277899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:58:01.88391467 +0000 UTC m=+1979.741808057" watchObservedRunningTime="2026-07-12 16:58:01.885409553 +0000 UTC m=+1979.743302939"
Jul 12 16:58:04.859294 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:04.859254    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 16:58:04.864068 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:04.864040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:04.866583 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:04.866560    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-cc457c-openshift-default-dockercfg-c5c9k\""
Jul 12 16:58:04.875812 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:04.875789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 16:58:05.021601 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5w92\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021768 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021926 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021926 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.021926 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.021883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122626 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122533    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5w92\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122626 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122626 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.122899 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.122774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.123254 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.123176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.123254 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.123219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.123254 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.123238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.123400 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.123321    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.123499 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.123458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.124879 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.124850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.125144 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.125127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.130889 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.130864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.131353 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.131336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5w92\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92\") pod \"e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") " pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.175437 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.175398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:05.333755 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.333660    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 16:58:05.335925 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:58:05.335885    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5e8822_46d5_461a_a1f4_777f4aedc4f9.slice/crio-d7b93a861c9d4c4ac57f8e78fd5424b30b9c9c1e5c806297f88b033d7ddc7b5f WatchSource:0}: Error finding container d7b93a861c9d4c4ac57f8e78fd5424b30b9c9c1e5c806297f88b033d7ddc7b5f: Status 404 returned error can't find the container with id d7b93a861c9d4c4ac57f8e78fd5424b30b9c9c1e5c806297f88b033d7ddc7b5f
Jul 12 16:58:05.338104 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.338068    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:05.338216 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.338148    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:05.338216 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.338188    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:05.891949 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.891899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerStarted","Data":"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"}
Jul 12 16:58:05.892470 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.891984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerStarted","Data":"d7b93a861c9d4c4ac57f8e78fd5424b30b9c9c1e5c806297f88b033d7ddc7b5f"}
Jul 12 16:58:05.914081 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:05.914024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podStartSLOduration=1.914005052 podStartE2EDuration="1.914005052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:58:05.911167421 +0000 UTC m=+1983.769060820" watchObservedRunningTime="2026-07-12 16:58:05.914005052 +0000 UTC m=+1983.771898438"
Jul 12 16:58:06.176138 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:06.176040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:06.181703 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:06.181675    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:06.899979 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:06.899865    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:06.904321 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:06.904060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:07.880277 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:07.880247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 16:58:08.031581 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.031525    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 16:58:08.035527 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.035501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.038270 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.038245    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-cc457c-serving-cert\""
Jul 12 16:58:08.044543 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.044516    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 16:58:08.154460 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.154356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.154891 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.154515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.154891 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.154572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2xh\" (UniqueName: \"kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.255970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.255913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.256146 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.256028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.256146 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.256069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2xh\" (UniqueName: \"kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.256698 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.256674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.258592 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.258568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.267437 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.267413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2xh\" (UniqueName: \"kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh\") pod \"maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.347298 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.347252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:08.534970 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.534944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 16:58:08.537215 ip-10-0-132-101 kubenswrapper[2577]: W0712 16:58:08.537182    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeeb070b_6e25_490a_a1e7_beedc902bee6.slice/crio-4a9fea2a3bdacc77afdaefef4bbc2a9200f906b1f6b3f68688a9a570a211dff9 WatchSource:0}: Error finding container 4a9fea2a3bdacc77afdaefef4bbc2a9200f906b1f6b3f68688a9a570a211dff9: Status 404 returned error can't find the container with id 4a9fea2a3bdacc77afdaefef4bbc2a9200f906b1f6b3f68688a9a570a211dff9
Jul 12 16:58:08.915463 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:08.915411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" event={"ID":"feeb070b-6e25-490a-a1e7-beedc902bee6","Type":"ContainerStarted","Data":"4a9fea2a3bdacc77afdaefef4bbc2a9200f906b1f6b3f68688a9a570a211dff9"}
Jul 12 16:58:09.921791 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:09.921752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" event={"ID":"feeb070b-6e25-490a-a1e7-beedc902bee6","Type":"ContainerStarted","Data":"496c7e93d696afab23e8b1b51c3baeb5c687c5378fa237d8b6b515059d7b6abf"}
Jul 12 16:58:09.922220 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:09.921897    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:09.941221 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:09.941165    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" podStartSLOduration=1.605964046 podStartE2EDuration="1.941147372s" totalImagesPullingTime="335.183326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 16:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 16:58:09.939846221 +0000 UTC m=+1987.797739609" watchObservedRunningTime="2026-07-12 16:58:09.941147372 +0000 UTC m=+1987.799040769"
Jul 12 16:58:12.938215 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.938179    2577 generic.go:356] "Generic (PLEG): container finished" podID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerID="c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d" exitCode=0
Jul 12 16:58:12.938728 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.938226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerDied","Data":"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"}
Jul 12 16:58:12.938728 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.938603    2577 scope.go:117] "RemoveContainer" containerID="c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"
Jul 12 16:58:12.939543 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.939512    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:12.939603 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.939583    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:12.939638 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:12.939620    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:13.943754 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:13.943720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerStarted","Data":"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"}
Jul 12 16:58:14.856143 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:14.856094    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:58:14.937298 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:14.937263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:58:14.937713 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:14.937662    2577 patch_prober.go:28] interesting pod/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 12 16:58:14.937943 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:14.937915    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 12 16:58:15.936292 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:15.936252    2577 patch_prober.go:28] interesting pod/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 12 16:58:15.937526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:15.937021    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 12 16:58:15.937526 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:15.937130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 16:58:16.936417 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:16.936370    2577 patch_prober.go:28] interesting pod/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 12 16:58:16.936810 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:16.936441    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 12 16:58:17.935743 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:17.935691    2577 patch_prober.go:28] interesting pod/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 12 16:58:17.936006 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:17.935776    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 12 16:58:18.940541 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:18.940511    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:58:18.941427 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:18.941405    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 16:58:20.975084 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.975054    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerID="636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2" exitCode=0
Jul 12 16:58:20.975419 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.975127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerDied","Data":"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"}
Jul 12 16:58:20.975634 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.975617    2577 scope.go:117] "RemoveContainer" containerID="636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"
Jul 12 16:58:20.976833 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.976795    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:20.976939 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.976900    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:20.976991 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:20.976954    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 12 16:58:21.899690 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:21.899639    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:21.981711 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:21.981677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerStarted","Data":"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"}
Jul 12 16:58:22.176168 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:22.176080    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:22.177262 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:22.177237    2577 patch_prober.go:28] interesting pod/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 12 16:58:22.177363 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:22.177285    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 12 16:58:23.175764 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:23.175720    2577 patch_prober.go:28] interesting pod/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 12 16:58:23.176213 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:23.175780    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 12 16:58:24.176145 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:24.176105    2577 patch_prober.go:28] interesting pod/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 12 16:58:24.176565 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:24.176162    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 12 16:58:25.176527 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:25.176461    2577 patch_prober.go:28] interesting pod/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 12 16:58:25.176927 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:25.176543    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 12 16:58:26.180087 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:26.180057    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:26.180457 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:26.180319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 16:58:26.181012 ip-10-0-132-101 kubenswrapper[2577]: I0712 16:58:26.180994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 17:00:00.137048 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.137006    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:00:00.140894 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.140874    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:00:00.141021 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.141002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"
Jul 12 17:00:00.143259 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.143238    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-682rd\""
Jul 12 17:00:00.144354 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.144331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"
Jul 12 17:00:00.148796 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.148774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:00:00.155398 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.155377    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"
Jul 12 17:00:00.162141 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.162111    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:00:00.162641 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.162620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"
Jul 12 17:00:00.325000 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.324962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:00:00.329009 ip-10-0-132-101 kubenswrapper[2577]: W0712 17:00:00.328982    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7194ee2c_9e4b_49fd_9f42_87a4d3219d36.slice/crio-f710361070b36d11cfd301dab41bea4e2b38c4a7688b56453089fc3612637b80 WatchSource:0}: Error finding container f710361070b36d11cfd301dab41bea4e2b38c4a7688b56453089fc3612637b80: Status 404 returned error can't find the container with id f710361070b36d11cfd301dab41bea4e2b38c4a7688b56453089fc3612637b80
Jul 12 17:00:00.338012 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.337988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:00:00.342269 ip-10-0-132-101 kubenswrapper[2577]: W0712 17:00:00.342245    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8a1869_8f7c_4181_8417_6409de37c284.slice/crio-a3af3531c26b252749cf8cd5fb7ec952fda77d1ff618b146323f110cc17d7cc9 WatchSource:0}: Error finding container a3af3531c26b252749cf8cd5fb7ec952fda77d1ff618b146323f110cc17d7cc9: Status 404 returned error can't find the container with id a3af3531c26b252749cf8cd5fb7ec952fda77d1ff618b146323f110cc17d7cc9
Jul 12 17:00:00.427780 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.427748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" event={"ID":"cf8a1869-8f7c-4181-8417-6409de37c284","Type":"ContainerStarted","Data":"a3af3531c26b252749cf8cd5fb7ec952fda77d1ff618b146323f110cc17d7cc9"}
Jul 12 17:00:00.428829 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:00.428805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" event={"ID":"7194ee2c-9e4b-49fd-9f42-87a4d3219d36","Type":"ContainerStarted","Data":"f710361070b36d11cfd301dab41bea4e2b38c4a7688b56453089fc3612637b80"}
Jul 12 17:00:01.434899 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:01.434857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" event={"ID":"cf8a1869-8f7c-4181-8417-6409de37c284","Type":"ContainerStarted","Data":"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"}
Jul 12 17:00:01.436340 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:01.436316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" event={"ID":"7194ee2c-9e4b-49fd-9f42-87a4d3219d36","Type":"ContainerStarted","Data":"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"}
Jul 12 17:00:01.451343 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:01.451292    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" podStartSLOduration=1.451276649 podStartE2EDuration="1.451276649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:00:01.449939216 +0000 UTC m=+2099.307832604" watchObservedRunningTime="2026-07-12 17:00:01.451276649 +0000 UTC m=+2099.309170036"
Jul 12 17:00:01.464729 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:01.464555    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" podStartSLOduration=1.464538976 podStartE2EDuration="1.464538976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:00:01.464267576 +0000 UTC m=+2099.322160962" watchObservedRunningTime="2026-07-12 17:00:01.464538976 +0000 UTC m=+2099.322432363"
Jul 12 17:00:02.683376 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:02.683343    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 17:00:02.686550 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:00:02.686530    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jrr97_3581a437-1425-4c3d-9645-809ce92c6c0f/ovn-acl-logging/0.log"
Jul 12 17:01:00.010123 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:00.010086    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:01:00.010595 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:00.010300    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" podUID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" containerName="cleanup" containerID="cri-o://c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d" gracePeriod=30
Jul 12 17:01:00.013938 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:00.013911    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:01:00.014136 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:00.014101    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" podUID="cf8a1869-8f7c-4181-8417-6409de37c284" containerName="cleanup" containerID="cri-o://65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546" gracePeriod=30
Jul 12 17:01:30.205077 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.205050    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"
Jul 12 17:01:30.231520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.231469    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"
Jul 12 17:01:30.837886 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.837842    2577 generic.go:356] "Generic (PLEG): container finished" podID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" containerID="c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d" exitCode=137
Jul 12 17:01:30.837886 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.837885    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"
Jul 12 17:01:30.838144 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.837887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" event={"ID":"7194ee2c-9e4b-49fd-9f42-87a4d3219d36","Type":"ContainerDied","Data":"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"}
Jul 12 17:01:30.838144 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.837942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x" event={"ID":"7194ee2c-9e4b-49fd-9f42-87a4d3219d36","Type":"ContainerDied","Data":"f710361070b36d11cfd301dab41bea4e2b38c4a7688b56453089fc3612637b80"}
Jul 12 17:01:30.838144 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.837960    2577 scope.go:117] "RemoveContainer" containerID="c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"
Jul 12 17:01:30.839248 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.839223    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf8a1869-8f7c-4181-8417-6409de37c284" containerID="65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546" exitCode=137
Jul 12 17:01:30.839365 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.839260    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"
Jul 12 17:01:30.839365 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.839270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" event={"ID":"cf8a1869-8f7c-4181-8417-6409de37c284","Type":"ContainerDied","Data":"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"}
Jul 12 17:01:30.839365 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.839306    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4" event={"ID":"cf8a1869-8f7c-4181-8417-6409de37c284","Type":"ContainerDied","Data":"a3af3531c26b252749cf8cd5fb7ec952fda77d1ff618b146323f110cc17d7cc9"}
Jul 12 17:01:30.846735 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.846713    2577 scope.go:117] "RemoveContainer" containerID="c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"
Jul 12 17:01:30.847019 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:01:30.847000    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d\": container with ID starting with c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d not found: ID does not exist" containerID="c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"
Jul 12 17:01:30.847099 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.847024    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d"} err="failed to get container status \"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d\": rpc error: code = NotFound desc = could not find container \"c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d\": container with ID starting with c58dd101d8d534b144f0fc8b9e5952a30c332752d66734008b5433d436cef47d not found: ID does not exist"
Jul 12 17:01:30.847099 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.847039    2577 scope.go:117] "RemoveContainer" containerID="65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"
Jul 12 17:01:30.853750 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.853725    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:01:30.854742 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.854725    2577 scope.go:117] "RemoveContainer" containerID="65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"
Jul 12 17:01:30.855021 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:01:30.855002    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546\": container with ID starting with 65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546 not found: ID does not exist" containerID="65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"
Jul 12 17:01:30.855078 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.855027    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546"} err="failed to get container status \"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546\": rpc error: code = NotFound desc = could not find container \"65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546\": container with ID starting with 65bca26c73e4863a36458992ce3c8d2187b6082e19f1c168567ec34a25712546 not found: ID does not exist"
Jul 12 17:01:30.860380 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.860354    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731260-5cj5x"]
Jul 12 17:01:30.869985 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.869959    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:01:30.871887 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:30.871866    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-cc457c-29731260-pp4w4"]
Jul 12 17:01:32.631944 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:32.631906    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" path="/var/lib/kubelet/pods/7194ee2c-9e4b-49fd-9f42-87a4d3219d36/volumes"
Jul 12 17:01:32.632319 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:01:32.632169    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8a1869-8f7c-4181-8417-6409de37c284" path="/var/lib/kubelet/pods/cf8a1869-8f7c-4181-8417-6409de37c284/volumes"
Jul 12 17:03:49.333997 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.333963    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 17:03:49.336558 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.334185    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" podUID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" containerName="maas-api" containerID="cri-o://2466b160a1ed91645f3c3998bdedbb3c4bf6cc36ed2dec5cf13726bda3de5516" gracePeriod=30
Jul 12 17:03:49.464412 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.464373    2577 generic.go:356] "Generic (PLEG): container finished" podID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" containerID="2466b160a1ed91645f3c3998bdedbb3c4bf6cc36ed2dec5cf13726bda3de5516" exitCode=0
Jul 12 17:03:49.464412 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.464405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" event={"ID":"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0","Type":"ContainerDied","Data":"2466b160a1ed91645f3c3998bdedbb3c4bf6cc36ed2dec5cf13726bda3de5516"}
Jul 12 17:03:49.580153 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.580126    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 17:03:49.703831 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.703741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") pod \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") "
Jul 12 17:03:49.703831 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.703801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca\") pod \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") "
Jul 12 17:03:49.703831 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.703819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9vhr\" (UniqueName: \"kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr\") pod \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\" (UID: \"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0\") "
Jul 12 17:03:49.704221 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.704192    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" (UID: "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:03:49.705910 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.705887    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr" (OuterVolumeSpecName: "kube-api-access-w9vhr") pod "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" (UID: "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0"). InnerVolumeSpecName "kube-api-access-w9vhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:03:49.705983 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.705966    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" (UID: "b08c5a99-a7c4-4b0b-926a-79bbadfc89d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:03:49.804666 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.804614    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:49.804666 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.804659    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:49.804666 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:49.804670    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9vhr\" (UniqueName: \"kubernetes.io/projected/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0-kube-api-access-w9vhr\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:50.470298 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.470267    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"
Jul 12 17:03:50.470298 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.470275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc" event={"ID":"b08c5a99-a7c4-4b0b-926a-79bbadfc89d0","Type":"ContainerDied","Data":"6016fa78e0c33923fb327252f06c075af9145ebb67c92b281ea19b61e7f667db"}
Jul 12 17:03:50.470824 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.470344    2577 scope.go:117] "RemoveContainer" containerID="2466b160a1ed91645f3c3998bdedbb3c4bf6cc36ed2dec5cf13726bda3de5516"
Jul 12 17:03:50.491265 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.491236    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 17:03:50.495867 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.495845    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-17d27e-6c745d9cc8-z2pvc"]
Jul 12 17:03:50.631538 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:50.631507    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" path="/var/lib/kubelet/pods/b08c5a99-a7c4-4b0b-926a-79bbadfc89d0/volumes"
Jul 12 17:03:55.092271 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:55.092194    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 17:03:55.092678 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:55.092449    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy" containerID="cri-o://d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed" gracePeriod=30
Jul 12 17:03:56.184522 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.184489    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 17:03:56.185000 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.184753    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" podUID="feeb070b-6e25-490a-a1e7-beedc902bee6" containerName="maas-api" containerID="cri-o://496c7e93d696afab23e8b1b51c3baeb5c687c5378fa237d8b6b515059d7b6abf" gracePeriod=30
Jul 12 17:03:56.500905 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.500876    2577 generic.go:356] "Generic (PLEG): container finished" podID="feeb070b-6e25-490a-a1e7-beedc902bee6" containerID="496c7e93d696afab23e8b1b51c3baeb5c687c5378fa237d8b6b515059d7b6abf" exitCode=0
Jul 12 17:03:56.501036 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.500948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" event={"ID":"feeb070b-6e25-490a-a1e7-beedc902bee6","Type":"ContainerDied","Data":"496c7e93d696afab23e8b1b51c3baeb5c687c5378fa237d8b6b515059d7b6abf"}
Jul 12 17:03:56.630094 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.630067    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 17:03:56.769146 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.769046    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls\") pod \"feeb070b-6e25-490a-a1e7-beedc902bee6\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") "
Jul 12 17:03:56.769146 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.769126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp2xh\" (UniqueName: \"kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh\") pod \"feeb070b-6e25-490a-a1e7-beedc902bee6\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") "
Jul 12 17:03:56.769381 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.769234    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca\") pod \"feeb070b-6e25-490a-a1e7-beedc902bee6\" (UID: \"feeb070b-6e25-490a-a1e7-beedc902bee6\") "
Jul 12 17:03:56.769628 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.769589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "feeb070b-6e25-490a-a1e7-beedc902bee6" (UID: "feeb070b-6e25-490a-a1e7-beedc902bee6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:03:56.771121 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.771089    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh" (OuterVolumeSpecName: "kube-api-access-mp2xh") pod "feeb070b-6e25-490a-a1e7-beedc902bee6" (UID: "feeb070b-6e25-490a-a1e7-beedc902bee6"). InnerVolumeSpecName "kube-api-access-mp2xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:03:56.771221 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.771119    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "feeb070b-6e25-490a-a1e7-beedc902bee6" (UID: "feeb070b-6e25-490a-a1e7-beedc902bee6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 17:03:56.870820 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.870788    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feeb070b-6e25-490a-a1e7-beedc902bee6-maas-api-tls\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:56.870820 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.870816    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp2xh\" (UniqueName: \"kubernetes.io/projected/feeb070b-6e25-490a-a1e7-beedc902bee6-kube-api-access-mp2xh\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:56.870820 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:56.870825    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feeb070b-6e25-490a-a1e7-beedc902bee6-openshift-service-ca\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:03:57.506673 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:57.506643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"
Jul 12 17:03:57.506673 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:57.506660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx" event={"ID":"feeb070b-6e25-490a-a1e7-beedc902bee6","Type":"ContainerDied","Data":"4a9fea2a3bdacc77afdaefef4bbc2a9200f906b1f6b3f68688a9a570a211dff9"}
Jul 12 17:03:57.507183 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:57.506719    2577 scope.go:117] "RemoveContainer" containerID="496c7e93d696afab23e8b1b51c3baeb5c687c5378fa237d8b6b515059d7b6abf"
Jul 12 17:03:57.527189 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:57.527162    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 17:03:57.531349 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:57.531322    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-cc457c-5ddc796fb8-7scsx"]
Jul 12 17:03:58.631250 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:03:58.631216    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feeb070b-6e25-490a-a1e7-beedc902bee6" path="/var/lib/kubelet/pods/feeb070b-6e25-490a-a1e7-beedc902bee6/volumes"
Jul 12 17:04:00.343424 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.343397    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 17:04:00.502304 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502304 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn9ch\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502304 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502304 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502300    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502582    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502605    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.502677 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502666    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs\") pod \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\" (UID: \"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7\") "
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502787    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.502956    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503064    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503222    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503244    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-workload-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503259    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istiod-ca-cert\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.503292 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503274    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-credential-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.503632 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.503553    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:00.504643 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.504613    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:00.504740 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.504698    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch" (OuterVolumeSpecName: "kube-api-access-xn9ch") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "kube-api-access-xn9ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:00.504991 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.504973    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:00.505041 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.505015    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" (UID: "e11fe2eb-692a-4ba0-82dc-0bf20ad549d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 17:04:00.522087 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.522058    2577 generic.go:356] "Generic (PLEG): container finished" podID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerID="d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed" exitCode=0
Jul 12 17:04:00.522229 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.522103    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"
Jul 12 17:04:00.522229 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.522132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerDied","Data":"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"}
Jul 12 17:04:00.522229 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.522168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs" event={"ID":"e11fe2eb-692a-4ba0-82dc-0bf20ad549d7","Type":"ContainerDied","Data":"1d784e6cfe1a635bd630397c8f0caa961d6a267122097798564207e4db788764"}
Jul 12 17:04:00.522229 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.522189    2577 scope.go:117] "RemoveContainer" containerID="d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"
Jul 12 17:04:00.531073 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.531054    2577 scope.go:117] "RemoveContainer" containerID="c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"
Jul 12 17:04:00.539060 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.539039    2577 scope.go:117] "RemoveContainer" containerID="d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"
Jul 12 17:04:00.539316 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:04:00.539297    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed\": container with ID starting with d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed not found: ID does not exist" containerID="d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"
Jul 12 17:04:00.539379 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.539329    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed"} err="failed to get container status \"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed\": rpc error: code = NotFound desc = could not find container \"d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed\": container with ID starting with d484ab04819e4cf9bf6dfd458e81007fc9f1bad1797e8d6c48968a051ef980ed not found: ID does not exist"
Jul 12 17:04:00.539379 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.539354    2577 scope.go:117] "RemoveContainer" containerID="c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"
Jul 12 17:04:00.539614 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:04:00.539593    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d\": container with ID starting with c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d not found: ID does not exist" containerID="c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"
Jul 12 17:04:00.539659 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.539620    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d"} err="failed to get container status \"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d\": rpc error: code = NotFound desc = could not find container \"c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d\": container with ID starting with c7c616376834372f071090fb89e5883cd3824716924b82e04e0c5b1a22ff394d not found: ID does not exist"
Jul 12 17:04:00.543849 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.543826    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 17:04:00.549368 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.549337    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-17d27e-openshift-default-59d8fc787-sdljs"]
Jul 12 17:04:00.603768 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.603722    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-podinfo\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.603768 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.603766    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn9ch\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-kube-api-access-xn9ch\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.603768 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.603777    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-token\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.603768 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.603785    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-data\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.604054 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.603793    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7-istio-envoy\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:00.631318 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:00.631289    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" path="/var/lib/kubelet/pods/e11fe2eb-692a-4ba0-82dc-0bf20ad549d7/volumes"
Jul 12 17:04:01.899559 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:01.899520    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 17:04:01.900104 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:01.899800    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy" containerID="cri-o://918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5" gracePeriod=30
Jul 12 17:04:07.153078 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.153049    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 17:04:07.270054 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.269964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270054 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270017    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270054 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270054 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270054    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270109    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5w92\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270151    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270173    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270206    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data\") pod \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\" (UID: \"fa5e8822-46d5-461a-a1f4-777f4aedc4f9\") "
Jul 12 17:04:07.270390 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270303    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:07.270753 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270468    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:07.270753 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270615    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.270753 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270664    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-workload-certs\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.270753 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270713    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:07.270961 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.270830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 17:04:07.271117 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.271092    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:07.272261 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.272235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 17:04:07.272391 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.272272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 17:04:07.272391 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.272347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92" (OuterVolumeSpecName: "kube-api-access-b5w92") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "kube-api-access-b5w92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:07.272558 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.272511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa5e8822-46d5-461a-a1f4-777f4aedc4f9" (UID: "fa5e8822-46d5-461a-a1f4-777f4aedc4f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 17:04:07.371381 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371324    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5w92\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-kube-api-access-b5w92\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371381 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371372    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istiod-ca-cert\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371381 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371387    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-token\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371381 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371399    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-credential-socket\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371714 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371411    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-data\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371714 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371422    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-envoy\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.371714 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.371433    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa5e8822-46d5-461a-a1f4-777f4aedc4f9-istio-podinfo\") on node \"ip-10-0-132-101.ec2.internal\" DevicePath \"\""
Jul 12 17:04:07.553468 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.553376    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerID="918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5" exitCode=0
Jul 12 17:04:07.553468 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.553424    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"
Jul 12 17:04:07.553737 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.553426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerDied","Data":"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"}
Jul 12 17:04:07.553737 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.553565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn" event={"ID":"fa5e8822-46d5-461a-a1f4-777f4aedc4f9","Type":"ContainerDied","Data":"d7b93a861c9d4c4ac57f8e78fd5424b30b9c9c1e5c806297f88b033d7ddc7b5f"}
Jul 12 17:04:07.553737 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.553603    2577 scope.go:117] "RemoveContainer" containerID="918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"
Jul 12 17:04:07.562716 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.562699    2577 scope.go:117] "RemoveContainer" containerID="636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"
Jul 12 17:04:07.570518 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.570494    2577 scope.go:117] "RemoveContainer" containerID="918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"
Jul 12 17:04:07.570826 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:04:07.570805    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5\": container with ID starting with 918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5 not found: ID does not exist" containerID="918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"
Jul 12 17:04:07.570918 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.570841    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5"} err="failed to get container status \"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5\": rpc error: code = NotFound desc = could not find container \"918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5\": container with ID starting with 918764ab47f75a2ae3072129dd52013b64ede152d8829e7118ffe8b12d47c1d5 not found: ID does not exist"
Jul 12 17:04:07.570918 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.570867    2577 scope.go:117] "RemoveContainer" containerID="636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"
Jul 12 17:04:07.571153 ip-10-0-132-101 kubenswrapper[2577]: E0712 17:04:07.571134    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2\": container with ID starting with 636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2 not found: ID does not exist" containerID="636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"
Jul 12 17:04:07.571205 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.571160    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2"} err="failed to get container status \"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2\": rpc error: code = NotFound desc = could not find container \"636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2\": container with ID starting with 636c936712f9d586c48e1181b94d82d36d3420ea94ff963bc08d82c9144c54d2 not found: ID does not exist"
Jul 12 17:04:07.574981 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.574957    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 17:04:07.579152 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:07.579130    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-cc457c-openshift-default-75b7856c87-qbqkn"]
Jul 12 17:04:08.105233 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:08.105206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869b4c4546-5xpb9_9501af38-dfea-4de5-8dfe-e062e2ed7bab/copy-manifests/0.log"
Jul 12 17:04:08.118282 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:08.118245    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869b4c4546-5xpb9_9501af38-dfea-4de5-8dfe-e062e2ed7bab/manager/0.log"
Jul 12 17:04:08.631700 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:08.631666    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" path="/var/lib/kubelet/pods/fa5e8822-46d5-461a-a1f4-777f4aedc4f9/volumes"
Jul 12 17:04:11.263388 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:11.263338    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tp4j5_87ad2c51-b3b6-4060-836c-754d5bb3eb4d/discovery/0.log"
Jul 12 17:04:11.379534 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:11.379508    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545795f48c-7bg4d_fe3ed45f-a18b-4e27-a28a-e5ac311007c7/kube-auth-proxy/0.log"
Jul 12 17:04:16.806087 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806053    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74brq/must-gather-clnbr"]
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806355    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806365    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806376    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" containerName="cleanup"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806381    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" containerName="cleanup"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806396    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806404    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806410    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeb070b-6e25-490a-a1e7-beedc902bee6" containerName="maas-api"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806415    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeb070b-6e25-490a-a1e7-beedc902bee6" containerName="maas-api"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806422    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8a1869-8f7c-4181-8417-6409de37c284" containerName="cleanup"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806427    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8a1869-8f7c-4181-8417-6409de37c284" containerName="cleanup"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806439    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806444    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806451    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" containerName="maas-api"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806457    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" containerName="maas-api"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806463    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806520 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806468    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806531    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08c5a99-a7c4-4b0b-926a-79bbadfc89d0" containerName="maas-api"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806548    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806554    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e11fe2eb-692a-4ba0-82dc-0bf20ad549d7" containerName="istio-proxy"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806560    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8a1869-8f7c-4181-8417-6409de37c284" containerName="cleanup"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806567    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7194ee2c-9e4b-49fd-9f42-87a4d3219d36" containerName="cleanup"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeb070b-6e25-490a-a1e7-beedc902bee6" containerName="maas-api"
Jul 12 17:04:16.806998 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.806659    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa5e8822-46d5-461a-a1f4-777f4aedc4f9" containerName="istio-proxy"
Jul 12 17:04:16.809793 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.809776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.812299 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.812268    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74brq\"/\"kube-root-ca.crt\""
Jul 12 17:04:16.812417 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.812399    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-74brq\"/\"default-dockercfg-w66hb\""
Jul 12 17:04:16.812495 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.812418    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-74brq\"/\"openshift-service-ca.crt\""
Jul 12 17:04:16.818198 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.818170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74brq/must-gather-clnbr"]
Jul 12 17:04:16.845690 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.845651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb8s5\" (UniqueName: \"kubernetes.io/projected/40f64229-8460-4cbd-8e9c-d6b2db914deb-kube-api-access-kb8s5\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.845853 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.845715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f64229-8460-4cbd-8e9c-d6b2db914deb-must-gather-output\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.946301 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.946263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f64229-8460-4cbd-8e9c-d6b2db914deb-must-gather-output\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.946500 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.946341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb8s5\" (UniqueName: \"kubernetes.io/projected/40f64229-8460-4cbd-8e9c-d6b2db914deb-kube-api-access-kb8s5\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.946692 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.946671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f64229-8460-4cbd-8e9c-d6b2db914deb-must-gather-output\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:16.954106 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:16.954080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb8s5\" (UniqueName: \"kubernetes.io/projected/40f64229-8460-4cbd-8e9c-d6b2db914deb-kube-api-access-kb8s5\") pod \"must-gather-clnbr\" (UID: \"40f64229-8460-4cbd-8e9c-d6b2db914deb\") " pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:17.132050 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:17.132012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74brq/must-gather-clnbr"
Jul 12 17:04:17.265204 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:17.265167    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74brq/must-gather-clnbr"]
Jul 12 17:04:17.269387 ip-10-0-132-101 kubenswrapper[2577]: W0712 17:04:17.269361    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40f64229_8460_4cbd_8e9c_d6b2db914deb.slice/crio-cbd4d779f7799b99c17f3450be642cf613476b15e30e2abdc01bdba086fc3486 WatchSource:0}: Error finding container cbd4d779f7799b99c17f3450be642cf613476b15e30e2abdc01bdba086fc3486: Status 404 returned error can't find the container with id cbd4d779f7799b99c17f3450be642cf613476b15e30e2abdc01bdba086fc3486
Jul 12 17:04:17.271267 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:17.271252    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 17:04:17.604424 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:17.604390    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74brq/must-gather-clnbr" event={"ID":"40f64229-8460-4cbd-8e9c-d6b2db914deb","Type":"ContainerStarted","Data":"cbd4d779f7799b99c17f3450be642cf613476b15e30e2abdc01bdba086fc3486"}
Jul 12 17:04:18.620883 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:18.620843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74brq/must-gather-clnbr" event={"ID":"40f64229-8460-4cbd-8e9c-d6b2db914deb","Type":"ContainerStarted","Data":"6b341a2d2ca8df23cb0dc6ee068c3650fdc6e17b09a52024440170203df6a1d3"}
Jul 12 17:04:18.621360 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:18.620896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74brq/must-gather-clnbr" event={"ID":"40f64229-8460-4cbd-8e9c-d6b2db914deb","Type":"ContainerStarted","Data":"0536411558de614b4d979041b4aff14111534931088a70990da6a90954a49731"}
Jul 12 17:04:18.640747 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:18.640692    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-74brq/must-gather-clnbr" podStartSLOduration=1.923414199 podStartE2EDuration="2.640677687s" totalImagesPullingTime="717.263488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 17:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:04:18.638434133 +0000 UTC m=+2356.496327522" watchObservedRunningTime="2026-07-12 17:04:18.640677687 +0000 UTC m=+2356.498571074"
Jul 12 17:04:19.617862 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:19.617824    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ldc5s_e2e96b4c-e36a-4a5c-afb5-5f64e1384ffa/global-pull-secret-syncer/0.log"
Jul 12 17:04:19.743961 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:19.743917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n8rnf_777d7576-e163-42c3-9ce4-cc0995083db5/konnectivity-agent/0.log"
Jul 12 17:04:19.767063 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:19.767024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-101.ec2.internal_9808c0a499f17cc6f6e482e1dbd2adfa/haproxy/0.log"
Jul 12 17:04:27.165804 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.165762    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/alertmanager/0.log"
Jul 12 17:04:27.187764 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.187736    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/config-reloader/0.log"
Jul 12 17:04:27.218596 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.218546    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/kube-rbac-proxy-web/0.log"
Jul 12 17:04:27.244120 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.244065    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/kube-rbac-proxy/0.log"
Jul 12 17:04:27.269979 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.269889    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/kube-rbac-proxy-metric/0.log"
Jul 12 17:04:27.293081 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.293047    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/prom-label-proxy/0.log"
Jul 12 17:04:27.313759 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.313724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e9254ddc-d440-4bf7-b7da-b3f7bd94af5e/init-config-reloader/0.log"
Jul 12 17:04:27.565286 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.565188    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kgc6s_3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83/kube-state-metrics/0.log"
Jul 12 17:04:27.584894 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.584772    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kgc6s_3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83/kube-rbac-proxy-main/0.log"
Jul 12 17:04:27.618293 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.618251    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kgc6s_3e84b7d4-cab8-4fc0-9bc0-1dfd6e915b83/kube-rbac-proxy-self/0.log"
Jul 12 17:04:27.771277 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.771241    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cv2mr_ad58a8ba-479c-4ee3-902e-b3ec6c2026f4/node-exporter/0.log"
Jul 12 17:04:27.791850 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.791774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cv2mr_ad58a8ba-479c-4ee3-902e-b3ec6c2026f4/kube-rbac-proxy/0.log"
Jul 12 17:04:27.813781 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.813756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cv2mr_ad58a8ba-479c-4ee3-902e-b3ec6c2026f4/init-textfile/0.log"
Jul 12 17:04:27.986461 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:27.986433    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/prometheus/0.log"
Jul 12 17:04:28.011285 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.011253    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/config-reloader/0.log"
Jul 12 17:04:28.033515 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.033469    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/thanos-sidecar/0.log"
Jul 12 17:04:28.053807 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.053723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/kube-rbac-proxy-web/0.log"
Jul 12 17:04:28.074224 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.074198    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/kube-rbac-proxy/0.log"
Jul 12 17:04:28.094676 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.094640    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/kube-rbac-proxy-thanos/0.log"
Jul 12 17:04:28.115217 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.115189    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c87f7954-ca37-48c9-9a2d-37b388c91665/init-config-reloader/0.log"
Jul 12 17:04:28.290437 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.290405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/thanos-query/0.log"
Jul 12 17:04:28.317247 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.317170    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/kube-rbac-proxy-web/0.log"
Jul 12 17:04:28.337109 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.337081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/kube-rbac-proxy/0.log"
Jul 12 17:04:28.359453 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.359426    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/prom-label-proxy/0.log"
Jul 12 17:04:28.384933 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.384904    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/kube-rbac-proxy-rules/0.log"
Jul 12 17:04:28.406715 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:28.406670    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64b8fd548-8fb56_f91ccd9a-1f92-4fb8-9dcc-b5cb701408d1/kube-rbac-proxy-metrics/0.log"
Jul 12 17:04:29.493202 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.493159    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"]
Jul 12 17:04:29.498170 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.498136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.506219 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.504596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"]
Jul 12 17:04:29.565486 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.565434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-proc\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.565486 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.565487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-lib-modules\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.565742 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.565570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-sys\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.565742 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.565608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-podres\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.565742 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.565630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v7td\" (UniqueName: \"kubernetes.io/projected/89320a45-b821-4805-993e-931e2d7ca387-kube-api-access-9v7td\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666339 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-sys\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666546 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-podres\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666546 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v7td\" (UniqueName: \"kubernetes.io/projected/89320a45-b821-4805-993e-931e2d7ca387-kube-api-access-9v7td\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666546 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-sys\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666793 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-podres\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666793 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-proc\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666793 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-lib-modules\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666946 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-lib-modules\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.666946 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.666897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89320a45-b821-4805-993e-931e2d7ca387-proc\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.675396 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.675366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v7td\" (UniqueName: \"kubernetes.io/projected/89320a45-b821-4805-993e-931e2d7ca387-kube-api-access-9v7td\") pod \"perf-node-gather-daemonset-xh7lh\" (UID: \"89320a45-b821-4805-993e-931e2d7ca387\") " pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:29.817088 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:29.816994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:30.002819 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:30.002702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"]
Jul 12 17:04:30.698214 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:30.698174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh" event={"ID":"89320a45-b821-4805-993e-931e2d7ca387","Type":"ContainerStarted","Data":"82a3ac8f8d3badf96f01b763795779509591d36ee44f18559fc04a1f0988aae6"}
Jul 12 17:04:30.698734 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:30.698238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh" event={"ID":"89320a45-b821-4805-993e-931e2d7ca387","Type":"ContainerStarted","Data":"1035452283a3d08e5237960cd2693bc902e4885a715fe3065cbb7df46db84026"}
Jul 12 17:04:30.698734 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:30.698310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:30.715370 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:30.715303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh" podStartSLOduration=1.715280326 podStartE2EDuration="1.715280326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 17:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 17:04:30.715271941 +0000 UTC m=+2368.573165330" watchObservedRunningTime="2026-07-12 17:04:30.715280326 +0000 UTC m=+2368.573173714"
Jul 12 17:04:32.413619 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:32.413592    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx4vz_cbf5dd38-a805-485a-9d47-a800b4e31f7a/dns/0.log"
Jul 12 17:04:32.435384 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:32.435359    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx4vz_cbf5dd38-a805-485a-9d47-a800b4e31f7a/kube-rbac-proxy/0.log"
Jul 12 17:04:32.502290 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:32.502257    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cztp_89057664-7631-465a-a2cc-a8266aa8ef21/dns-node-resolver/0.log"
Jul 12 17:04:33.096741 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:33.096709    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-577c6dfbcb-46b5c_5bbb2221-94ee-40b0-8280-6d7b3e52e2ba/registry/0.log"
Jul 12 17:04:33.143117 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:33.143072    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m277f_c59f85eb-f22c-4e06-8bfb-d7a1a933d084/node-ca/0.log"
Jul 12 17:04:34.232979 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:34.232939    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tp4j5_87ad2c51-b3b6-4060-836c-754d5bb3eb4d/discovery/0.log"
Jul 12 17:04:34.255208 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:34.255162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545795f48c-7bg4d_fe3ed45f-a18b-4e27-a28a-e5ac311007c7/kube-auth-proxy/0.log"
Jul 12 17:04:35.184843 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:35.184813    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xprwl_1efdd617-8b97-489f-9a4f-7798b6b597f0/serve-healthcheck-canary/0.log"
Jul 12 17:04:35.697440 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:35.697407    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxhh5_7d09975a-2371-43bd-b98b-8be88553b701/kube-rbac-proxy/0.log"
Jul 12 17:04:35.718875 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:35.718848    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxhh5_7d09975a-2371-43bd-b98b-8be88553b701/exporter/0.log"
Jul 12 17:04:35.744664 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:35.744624    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gxhh5_7d09975a-2371-43bd-b98b-8be88553b701/extractor/0.log"
Jul 12 17:04:36.716522 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:36.716467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-74brq/perf-node-gather-daemonset-xh7lh"
Jul 12 17:04:38.718442 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:38.718405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869b4c4546-5xpb9_9501af38-dfea-4de5-8dfe-e062e2ed7bab/manager/0.log"
Jul 12 17:04:38.735620 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:38.735594    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-869b4c4546-5xpb9_9501af38-dfea-4de5-8dfe-e062e2ed7bab/copy-manifests/0.log"
Jul 12 17:04:40.099831 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:40.099801    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b84b79bc8-c27st_e6275033-1d4c-4c88-b15a-a6c755177feb/manager/0.log"
Jul 12 17:04:40.453432 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:40.453337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tp4j5_87ad2c51-b3b6-4060-836c-754d5bb3eb4d/discovery/0.log"
Jul 12 17:04:40.466471 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:40.466440    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545795f48c-7bg4d_fe3ed45f-a18b-4e27-a28a-e5ac311007c7/kube-auth-proxy/0.log"
Jul 12 17:04:41.913934 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:41.913903    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tp4j5_87ad2c51-b3b6-4060-836c-754d5bb3eb4d/discovery/0.log"
Jul 12 17:04:41.926472 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:41.926446    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545795f48c-7bg4d_fe3ed45f-a18b-4e27-a28a-e5ac311007c7/kube-auth-proxy/0.log"
Jul 12 17:04:46.429884 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.429804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8tt59_654d16c2-805b-4dbf-bba9-027d267bcf6e/kube-multus/0.log"
Jul 12 17:04:46.450687 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.450658    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/kube-multus-additional-cni-plugins/0.log"
Jul 12 17:04:46.470336 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.470304    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/egress-router-binary-copy/0.log"
Jul 12 17:04:46.490985 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.490963    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/cni-plugins/0.log"
Jul 12 17:04:46.511442 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.511409    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/bond-cni-plugin/0.log"
Jul 12 17:04:46.533156 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.533130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/routeoverride-cni/0.log"
Jul 12 17:04:46.553741 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.553701    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/whereabouts-cni-bincopy/0.log"
Jul 12 17:04:46.573100 ip-10-0-132-101 kubenswrapper[2577]: I0712 17:04:46.573063    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7glcg_24d22bcd-295e-4ff5-a7bd-9e874e60e8c0/whereabouts-cni/0.log"