Jul 16 13:40:34.650469 ip-10-0-137-62 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 13:40:34.982440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.981167    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984529    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984541    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984544    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984548    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984550    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984553    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984556    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984559    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984562    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984565    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984568    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984570    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984573    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984575    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984578    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984581    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984583    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984586    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:35.135023 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984589    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:35.047296 ip-10-0-137-62 systemd[1]: Started Kubernetes Kubelet.
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984591    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984594    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984597    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984599    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984602    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984605    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984607    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984610    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984613    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984616    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984619    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984622    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984624    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984627    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984629    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984632    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984634    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984637    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984639    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984642    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:35.136990 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984645    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984647    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984649    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984652    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984655    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984658    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984660    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984663    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984665    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984668    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984670    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984673    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984675    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984678    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984680    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984683    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984686    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984688    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984691    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984693    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:35.137710 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984696    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984699    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984702    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984704    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984708    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984712    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984716    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984719    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984722    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984725    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984729    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984734    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984737    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984740    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984742    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984746    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984748    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984751    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984754    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:35.138306 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984756    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984759    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984761    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984764    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984766    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984770    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984774    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984777    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984781    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984784    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984787    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984790    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984792    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984794    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984797    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984800    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984802    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984805    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984807    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:35.138942 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984810    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.984813    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985532    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985540    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985544    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985547    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985550    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985554    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985557    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985559    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985562    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985565    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985568    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985570    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985573    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985575    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985578    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985581    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985584    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:35.139794 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985586    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985589    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985592    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985594    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985597    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985600    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985602    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985605    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985607    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985613    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985616    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985620    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985623    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985626    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985629    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985632    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985635    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985638    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985640    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:35.140495 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985643    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985645    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985649    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985651    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985654    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985657    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985660    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985663    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985666    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985668    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985671    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985675    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985677    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985680    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985682    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985685    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985688    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985690    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985693    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:35.281998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985695    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985698    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985700    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985703    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985705    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985708    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985711    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985713    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985716    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985718    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985721    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985723    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985726    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985728    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985731    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985733    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985736    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985738    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985741    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985744    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:35.304971 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985747    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985749    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985752    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985754    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985757    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985759    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985764    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985768    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985771    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985773    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985776    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985778    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985781    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985783    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985786    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985791    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985793    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985796    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985798    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:35.306086 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985801    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985804    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985806    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.985808    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986164    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986168    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986171    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986174    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986177    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986180    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986183    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986186    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986188    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986191    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986193    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986196    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986198    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986222    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986226    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986229    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:35.307102 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986232    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986235    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986237    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986241    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986244    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986246    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986249    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986251    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986254    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986256    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986259    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986261    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986267    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986270    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986272    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986275    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986278    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986280    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986283    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:35.307724 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986286    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986289    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986292    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986295    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986298    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986300    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986303    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986306    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986308    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986311    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986314    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986316    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986319    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986322    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986324    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986327    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986329    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986332    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986334    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986337    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:35.308348 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986339    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986342    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986345    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986347    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986350    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986357    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986359    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986362    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986364    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986367    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986369    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986372    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986375    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986377    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986380    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986383    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986386    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986389    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986392    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986394    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:35.308964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986397    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986399    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986402    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986404    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986407    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986409    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986412    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986415    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986417    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986419    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986422    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986424    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986427    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986429    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986432    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986434    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986437    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986442    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986446    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:35.309582 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986449    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986452    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986455    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986457    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.986460    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986535    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986541    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986548    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986552    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986557    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986561    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986566    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986569    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986573    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986576    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986580    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986583    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986586    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986589    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986592    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986595    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986598    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986601    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986606    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 16 13:40:35.310199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986609    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986611    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986615    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986618    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986622    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986625    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986630    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986633    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986636    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986639    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986642    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986645    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986648    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986652    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986655    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986658    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986660    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986663    2558 flags.go:64] FLAG: --enable-server="true"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986667    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986671    2558 flags.go:64] FLAG: --event-burst="100"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986674    2558 flags.go:64] FLAG: --event-qps="50"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986677    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986680    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986682    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 16 13:40:35.310865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986686    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986689    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986692    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986695    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986698    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986701    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986704    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986707    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986709    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986712    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986715    2558 flags.go:64] FLAG: --feature-gates=""
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986719    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986722    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986725    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986730    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986733    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986736    2558 flags.go:64] FLAG: --help="false"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986739    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-137-62.ec2.internal"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986742    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986745    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986748    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986751    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986755    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986758    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 13:40:35.311528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986760    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986763    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986766    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986769    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986772    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986775    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986778    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986781    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986784    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986787    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986790    2558 flags.go:64] FLAG: --lock-file=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986792    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986795    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986798    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986804    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986806    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986809    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986812    2558 flags.go:64] FLAG: --logging-format="text"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986815    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986818    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986821    2558 flags.go:64] FLAG: --manifest-url=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986824    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986831    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986834    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986838    2558 flags.go:64] FLAG: --max-pods="110"
Jul 16 13:40:35.312242 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986841    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986844    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986847    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986850    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986853    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986856    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986859    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986866    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986868    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986871    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986875    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986878    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986883    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986886    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986889    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986892    2558 flags.go:64] FLAG: --port="10250"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986895    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986898    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a86e4642dda8ac18"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986901    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986904    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986907    2558 flags.go:64] FLAG: --register-node="true"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986910    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986913    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986916    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 16 13:40:35.312942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986919    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986922    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986925    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986928    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986931    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986935    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986939    2558 flags.go:64] FLAG: --runonce="false"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986942    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986945    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986948    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986951    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986954    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986957    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986960    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986963    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986966    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986968    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986971    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986974    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986977    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986986    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986989    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986995    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.986997    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987000    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 13:40:35.313653 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987007    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987010    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987013    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987016    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987019    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987021    2558 flags.go:64] FLAG: --v="2"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987025    2558 flags.go:64] FLAG: --version="false"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987031    2558 flags.go:64] FLAG: --vmodule=""
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987034    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.987037    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987186    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987190    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987195    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987218    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987223    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987227    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987230    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987233    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987236    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987238    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987241    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987243    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:35.314725 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987246    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987249    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987252    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987254    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987257    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987260    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987263    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987266    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987269    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987271    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987273    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987276    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987279    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987281    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987284    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987286    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987289    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987293    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987296    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:35.315351 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987300    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987303    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987306    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987310    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987314    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987317    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987319    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987322    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987325    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987329    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987332    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987335    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987337    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987340    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987342    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987345    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987347    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987350    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987353    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987355    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:36.678964 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987359    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987361    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987364    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987366    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987369    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987380    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987384    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987386    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987389    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987391    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987394    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987396    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987399    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987402    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987404    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987408    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987412    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987415    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987417    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987420    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:36.679961 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987423    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987426    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987430    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987433    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987436    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987438    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987441    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987444    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987446    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987449    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987452    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987455    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987458    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987461    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987464    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987467    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987470    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987472    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987475    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987478    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:36.680630 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987481    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987484    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987487    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987490    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987492    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987495    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987498    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.987502    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.988274    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.995317    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.995333    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.996031    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.996044    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996126    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:36.681257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996134    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996140    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996144    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996148    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996153    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996157    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996161    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996166    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996170    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996173    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996177    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996182    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996186    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996190    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996194    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996197    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996218    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996223    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996227    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996231    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:36.681681 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996235    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996239    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996242    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996246    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996249    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996256    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996260    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996265    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996270    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996273    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996277    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996281    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996284    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996288    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996292    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996296    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996299    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996303    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996307    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996310    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:36.682257 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996314    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996318    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996322    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996325    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996330    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996334    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996338    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996341    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996345    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996348    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996352    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996355    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996360    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996363    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996366    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996370    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996374    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996379    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996384    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:36.682795 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996389    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996392    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996396    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996400    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996403    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996408    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996412    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996416    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996420    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996423    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996427    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996430    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996434    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996438    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996441    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996445    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996451    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996456    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996462    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:36.683336 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996465    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996469    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996473    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996476    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996480    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996484    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996487    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996491    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996497    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996501    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996505    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996511    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996514    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996520    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996524    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996528    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996532    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996536    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996539    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:36.683903 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996543    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.996551    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996712    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996718    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996722    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996726    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996730    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996734    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996740    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996745    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996749    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996753    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996757    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996762    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996766    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 13:40:36.684446 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996769    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996773    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996777    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996780    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996784    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996788    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996792    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996795    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996799    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996805    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996808    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996812    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996819    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996824    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996828    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996832    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996837    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996841    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996845    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 13:40:36.684929 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996848    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996852    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996856    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996859    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996863    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996867    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996870    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996874    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996878    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996882    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996885    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996889    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996893    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996897    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996900    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996904    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996908    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996911    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996915    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996918    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 13:40:36.685549 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996923    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996926    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996931    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996935    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996938    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996943    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996947    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996950    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996954    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996958    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996962    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996966    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996970    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996973    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996977    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996980    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996984    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996988    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996991    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996995    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 13:40:36.686091 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.996999    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997003    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997006    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997010    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997014    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997018    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997023    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997027    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997030    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997034    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997037    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997042    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997047    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997051    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997057    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997061    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997065    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997072    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997076    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997080    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 13:40:36.686680 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997084    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997087    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997091    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997095    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997098    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997102    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:34.997106    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.997113    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.997248    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:34.999553    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.000772    2558 server.go:1019] "Starting client certificate rotation"
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.000876    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.000917    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 13:40:36.687247 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.003015    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.007462    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.014310    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.016416    2558 log.go:25] "Validated CRI v1 image API"
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.017940    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.019997    2558 fs.go:135] Filesystem UUIDs: map[04803be3-eb13-4d9e-a67e-5e006756c25d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c6acc185-d422-4c0a-9473-09b3d06ddb07:/dev/nvme0n1p3]
Jul 16 13:40:36.687662 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.020023    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.026688    2558 manager.go:216] Machine: {Timestamp:2026-07-16 13:40:35.025593519 +0000 UTC m=+0.274910411 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101895 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f0a5825a03eb9b5b814234e2fe2a SystemUUID:ec28f0a5-825a-03eb-9b5b-814234e2fe2a BootID:de48d68f-b91d-491e-96a0-a1c8abecb350 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:e3:e3:db:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:e3:e3:db:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:52:8c:5c:52:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.026787    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.026858    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.029264    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.029305    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.030425    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.030436    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.030443    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.031017    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.031142    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.032371    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036116    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036258    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036282    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036291    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036303    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 13:40:36.687933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036311    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036321    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036635    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.036652    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.040434    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042163    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042190    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042365    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042383    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042392    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042398    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042407    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042413    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042747    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042755    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042761    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042767    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042775    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.042782    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.043368    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.043389    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.046470    2558 server.go:1268] "Started kubelet"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.046543    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.046620    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.046695    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.050560    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.052499    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.052594    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.054190    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.055330    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.055756    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058224    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058244    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.058289    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.057775    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-62.ec2.internal.18c2c8d89bea1ecb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-62.ec2.internal,UID:ip-10-0-137-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-62.ec2.internal,},FirstTimestamp:2026-07-16 13:40:35.046440651 +0000 UTC m=+0.295757524,LastTimestamp:2026-07-16 13:40:35.046440651 +0000 UTC m=+0.295757524,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-62.ec2.internal,}"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058781    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058812    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058827    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058929    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.058937    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059085    2558 factory.go:55] Registering systemd factory
Jul 16 13:40:36.688434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059120    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059370    2558 factory.go:153] Registering CRI-O factory
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059396    2558 factory.go:223] Registration of the crio container factory successfully
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059445    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059467    2558 factory.go:103] Registering Raw factory
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059480    2558 manager.go:1196] Started watching for new ooms in manager
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.059832    2558 manager.go:349] Starting recovery of all containers
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.060907    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcrdc"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.067766    2558 manager.go:354] Recovery completed
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.069310    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zcrdc"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.069447    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.069564    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.071841    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.075419    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.075450    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.075463    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.075994    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076005    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076020    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076022    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076727    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076750    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.076759    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.077759    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-62.ec2.internal.18c2c8d89da49641  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-62.ec2.internal,UID:ip-10-0-137-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-62.ec2.internal,},FirstTimestamp:2026-07-16 13:40:35.075438145 +0000 UTC m=+0.324755020,LastTimestamp:2026-07-16 13:40:35.075438145 +0000 UTC m=+0.324755020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-62.ec2.internal,}"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.078068    2558 policy_none.go:49] "None policy: Start"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.078090    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.078112    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.080177    2558 policy_none.go:47] "Start"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.138744    2558 manager.go:337] "Starting Device Plugin manager"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.138884    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.138894    2558 server.go:87] "Starting device plugin registration server"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.139103    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.139113    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.139196    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.139305    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.139314    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.139721    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.139774    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.239464    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.689612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.240654    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.240687    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.240699    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.240731    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.246637    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.246656    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-62.ec2.internal\": node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.247099    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.252658    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.252692    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.252712    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.252743    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:35.255144    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:35.260499    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.603759    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"]
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.604437    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.605776    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.605804    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.605814    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.608107    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.608227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.608258    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610100    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610125    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610154    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610170    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610131    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06ac39ebd4fa4a02fa3ca1bc0e53b517-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"06ac39ebd4fa4a02fa3ca1bc0e53b517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.610188    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.610892    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.612333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.612356    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.613196    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.613226    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 13:40:36.693518 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.613237    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeHasSufficientPID"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.670351    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.680352    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-62.ec2.internal\" not found" node="ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.710925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.710948    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06ac39ebd4fa4a02fa3ca1bc0e53b517-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"06ac39ebd4fa4a02fa3ca1bc0e53b517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.710982    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.710981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.711001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.711020    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a4b96753b88ae6c42256558ecb1e9d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal\" (UID: \"2a4b96753b88ae6c42256558ecb1e9d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.711030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/06ac39ebd4fa4a02fa3ca1bc0e53b517-config\") pod \"kube-apiserver-proxy-ip-10-0-137-62.ec2.internal\" (UID: \"06ac39ebd4fa4a02fa3ca1bc0e53b517\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:36.838301 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.811553    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:36.967367 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:36.911910    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:37.117440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.972078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:37.117440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:36.982972    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:37.117440 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.012500    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:37.117440 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.112878    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.213271    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-62.ec2.internal\" not found"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.251431    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.251577    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.265151    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.289208    2558 apiserver.go:52] "Watching apiserver"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.299661    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.300663    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662","openshift-dns/node-resolver-kmf9r","openshift-multus/multus-additional-cni-plugins-qv2x5","openshift-multus/multus-sprk4","openshift-network-diagnostics/network-check-target-46lgl","openshift-network-operator/iptables-alerter-4zwpz","kube-system/konnectivity-agent-zb5c2","openshift-cluster-node-tuning-operator/tuned-crld6","openshift-image-registry/node-ca-8m4ms","openshift-multus/network-metrics-daemon-726ml","openshift-ovn-kubernetes/ovnkube-node-7fclh","kube-system/global-pull-secret-syncer-n4vfc"]
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.303115    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.305307    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.305459    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 13:40:37.307846 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.307370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.312711 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.311759    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.312711 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.311944    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cm7sn\""
Jul 16 13:40:37.312711 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.311938    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 13:40:37.312959 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.312712    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.312971    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.313080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.313372    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.313649    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314511    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsbl\" (UniqueName: \"kubernetes.io/projected/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kube-api-access-6hsbl\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-cnibin\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-multus\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-etc-kubernetes\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-socket-dir-parent\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-etc-selinux\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314906    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rzzm9\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bd44e71-7096-4513-9215-4432fb3bb979-tmp-dir\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.314958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-os-release\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.315066    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.315240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-cni-binary-copy\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.315938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-system-cni-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.315972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-k8s-cni-cncf-io\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.432946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-kubelet\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-socket-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bd44e71-7096-4513-9215-4432fb3bb979-hosts-file\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-os-release\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-netns\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-bin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-hostroot\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqjbg\" (UniqueName: \"kubernetes.io/projected/9bd44e71-7096-4513-9215-4432fb3bb979-kube-api-access-vqjbg\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkxg7\" (UniqueName: \"kubernetes.io/projected/e53e301e-013f-4314-809e-4cad5c5d64c0-kube-api-access-mkxg7\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9tx\" (UniqueName: \"kubernetes.io/projected/f9f1bf03-b72f-4618-8beb-0ead64957375-kube-api-access-5z9tx\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-multus-certs\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-registration-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.434838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-device-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-sys-fs\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.316822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-system-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.317140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.317165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-cnibin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.317186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-conf-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.317206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-daemon-config\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.320665    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.320786    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.321033    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rhkqz\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.321891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.324057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.324132    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.324186    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.324207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5prbr\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.326201    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 13:35:36 +0000 UTC" deadline="2028-03-02 10:17:46.903414094 +0000 UTC"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.326236    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14276h37m9.577180477s"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.326347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.327150    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.327198    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.328513    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334373    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334397    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334437    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-66tpr\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334528    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334556    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334680    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334804    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nrmkr\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.334926    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.435891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.336805    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.336924    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4gkh\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.336931    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.337081    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.337201    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.339459    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.339556    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.339610    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.339771    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.339978    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.340047    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zpxss\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.341926    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.343762    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344092    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal"]
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344140    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal"]
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344183    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344203    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.344244    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344323    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344368    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344477    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344671    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bhxvl\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344724    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.344760    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.351540    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2kfb"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.362861    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2kfb"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.410706    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsbl\" (UniqueName: \"kubernetes.io/projected/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kube-api-access-6hsbl\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-multus\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418058    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-etc-kubernetes\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.438521 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-kubelet-config\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-dbus\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-multus\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-kubelet\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-etc-kubernetes\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-netns\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-etc-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-etc-selinux\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bd44e71-7096-4513-9215-4432fb3bb979-tmp-dir\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-os-release\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-sys\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418322    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-etc-selinux\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-os-release\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-var-lib-kubelet\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjpx2\" (UniqueName: \"kubernetes.io/projected/8d66373d-40f1-4521-aa76-1c34b8406d1c-kube-api-access-tjpx2\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba2d7a3-087b-4395-bec7-2b44def67046-ovn-node-metrics-cert\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.439973 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-system-cni-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-kubelet\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-conf\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-system-cni-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-etc-tuned\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-kubelet\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d66373d-40f1-4521-aa76-1c34b8406d1c-host\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-ovn\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bd44e71-7096-4513-9215-4432fb3bb979-tmp-dir\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-node-log\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418661    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bd44e71-7096-4513-9215-4432fb3bb979-hosts-file\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbc9984e-1cce-47e8-b41f-7db5814eddbb-host-slash\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8zwq\" (UniqueName: \"kubernetes.io/projected/47dc235e-43e7-48c9-8d3d-473816e01efc-kube-api-access-z8zwq\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418729    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bd44e71-7096-4513-9215-4432fb3bb979-hosts-file\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-lib-modules\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-var-lib-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:37.441450 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqjbg\" (UniqueName: \"kubernetes.io/projected/9bd44e71-7096-4513-9215-4432fb3bb979-kube-api-access-vqjbg\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2gs\" (UniqueName: \"kubernetes.io/projected/fbc9984e-1cce-47e8-b41f-7db5814eddbb-kube-api-access-bf2gs\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-env-overrides\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-multus-certs\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.418988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d66373d-40f1-4521-aa76-1c34b8406d1c-serviceca\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-systemd-units\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-slash\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419041    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-multus-certs\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-netd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419095    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-config\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-device-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-device-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-sys-fs\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419182    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-system-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.442322 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-conf-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-sys-fs\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-daemon-config\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419251    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-conf-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-system-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-modprobe-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysconfig\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-cnibin\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f9f1bf03-b72f-4618-8beb-0ead64957375-cnibin\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-kubernetes\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4bbn\" (UniqueName: \"kubernetes.io/projected/29e576c2-307d-446a-a3c8-3052ff265beb-kube-api-access-h4bbn\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-bin\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-script-lib\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2q8\" (UniqueName: \"kubernetes.io/projected/3ba2d7a3-087b-4395-bec7-2b44def67046-kube-api-access-wz2q8\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.444018 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-socket-dir-parent\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-cni-binary-copy\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-socket-dir-parent\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-k8s-cni-cncf-io\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-k8s-cni-cncf-io\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbc9984e-1cce-47e8-b41f-7db5814eddbb-iptables-alerter-script\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-run\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-socket-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-os-release\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-netns\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-daemon-config\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-bin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419800    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-socket-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.444882 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-hostroot\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkxg7\" (UniqueName: \"kubernetes.io/projected/e53e301e-013f-4314-809e-4cad5c5d64c0-kube-api-access-mkxg7\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-systemd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-run-netns\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-hostroot\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-os-release\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9tx\" (UniqueName: \"kubernetes.io/projected/f9f1bf03-b72f-4618-8beb-0ead64957375-kube-api-access-5z9tx\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-host-var-lib-cni-bin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/204eab9e-1b40-45f5-be0d-1fd142340ac9-agent-certs\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/204eab9e-1b40-45f5-be0d-1fd142340ac9-konnectivity-ca\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-tmp\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-log-socket\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-registration-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.419998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-cnibin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-systemd\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.445750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-host\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e53e301e-013f-4314-809e-4cad5c5d64c0-cni-binary-copy\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/955fa79b-cb4a-41ac-bdd0-3496afb0c014-registration-dir\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-cnibin\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e53e301e-013f-4314-809e-4cad5c5d64c0-multus-cni-dir\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.420353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f9f1bf03-b72f-4618-8beb-0ead64957375-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.427237    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 13:40:37.446618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.430475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqjbg\" (UniqueName: \"kubernetes.io/projected/9bd44e71-7096-4513-9215-4432fb3bb979-kube-api-access-vqjbg\") pod \"node-resolver-kmf9r\" (UID: \"9bd44e71-7096-4513-9215-4432fb3bb979\") " pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.453322    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkxg7\" (UniqueName: \"kubernetes.io/projected/e53e301e-013f-4314-809e-4cad5c5d64c0-kube-api-access-mkxg7\") pod \"multus-sprk4\" (UID: \"e53e301e-013f-4314-809e-4cad5c5d64c0\") " pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.453359    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsbl\" (UniqueName: \"kubernetes.io/projected/955fa79b-cb4a-41ac-bdd0-3496afb0c014-kube-api-access-6hsbl\") pod \"aws-ebs-csi-driver-node-gj662\" (UID: \"955fa79b-cb4a-41ac-bdd0-3496afb0c014\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.453876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9tx\" (UniqueName: \"kubernetes.io/projected/f9f1bf03-b72f-4618-8beb-0ead64957375-kube-api-access-5z9tx\") pod \"multus-additional-cni-plugins-qv2x5\" (UID: \"f9f1bf03-b72f-4618-8beb-0ead64957375\") " pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.520978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-kubelet-config\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-dbus\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521027    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-kubelet\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-netns\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-etc-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-sys\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-var-lib-kubelet\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-kubelet\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-netns\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-dbus\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-sys\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjpx2\" (UniqueName: \"kubernetes.io/projected/8d66373d-40f1-4521-aa76-1c34b8406d1c-kube-api-access-tjpx2\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-etc-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.607801 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/66c55ac9-cb12-429a-b72c-7ac948ed30a6-kubelet-config\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521167    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-var-lib-kubelet\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521242    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba2d7a3-087b-4395-bec7-2b44def67046-ovn-node-metrics-cert\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-conf\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-etc-tuned\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d66373d-40f1-4521-aa76-1c34b8406d1c-host\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-ovn\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521343    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-node-log\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbc9984e-1cce-47e8-b41f-7db5814eddbb-host-slash\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8zwq\" (UniqueName: \"kubernetes.io/projected/47dc235e-43e7-48c9-8d3d-473816e01efc-kube-api-access-z8zwq\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-ovn\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-lib-modules\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-conf\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-node-log\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d66373d-40f1-4521-aa76-1c34b8406d1c-host\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.608913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-var-lib-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbc9984e-1cce-47e8-b41f-7db5814eddbb-host-slash\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2gs\" (UniqueName: \"kubernetes.io/projected/fbc9984e-1cce-47e8-b41f-7db5814eddbb-kube-api-access-bf2gs\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-lib-modules\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521537    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-env-overrides\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-var-lib-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d66373d-40f1-4521-aa76-1c34b8406d1c-serviceca\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-systemd-units\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521638    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysctl-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-slash\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-netd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-systemd-units\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-config\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.521838    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-netd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.610825 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.522011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-env-overrides\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.522201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8d66373d-40f1-4521-aa76-1c34b8406d1c-serviceca\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.522362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-config\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.522386    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.523950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-etc-tuned\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-slash\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.526289    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:40:38.022433978 +0000 UTC m=+2.021465839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-modprobe-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysconfig\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-kubernetes\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4bbn\" (UniqueName: \"kubernetes.io/projected/29e576c2-307d-446a-a3c8-3052ff265beb-kube-api-access-h4bbn\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-modprobe-d\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-sysconfig\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-bin\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-kubernetes\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.611893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-openvswitch\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-cni-bin\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.526540    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.526604    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:40:38.026589158 +0000 UTC m=+2.025621032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-script-lib\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2q8\" (UniqueName: \"kubernetes.io/projected/3ba2d7a3-087b-4395-bec7-2b44def67046-kube-api-access-wz2q8\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ba2d7a3-087b-4395-bec7-2b44def67046-ovnkube-script-lib\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.526952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ba2d7a3-087b-4395-bec7-2b44def67046-ovn-node-metrics-cert\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbc9984e-1cce-47e8-b41f-7db5814eddbb-iptables-alerter-script\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-run\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-systemd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/204eab9e-1b40-45f5-be0d-1fd142340ac9-agent-certs\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-run\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/204eab9e-1b40-45f5-be0d-1fd142340ac9-konnectivity-ca\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-run-systemd\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-tmp\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-log-socket\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.612763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-systemd\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-host\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-host-run-ovn-kubernetes\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-etc-systemd\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29e576c2-307d-446a-a3c8-3052ff265beb-host\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527527    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ba2d7a3-087b-4395-bec7-2b44def67046-log-socket\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.527587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fbc9984e-1cce-47e8-b41f-7db5814eddbb-iptables-alerter-script\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.528207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/204eab9e-1b40-45f5-be0d-1fd142340ac9-konnectivity-ca\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.529056    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29e576c2-307d-446a-a3c8-3052ff265beb-tmp\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.529736    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/204eab9e-1b40-45f5-be0d-1fd142340ac9-agent-certs\") pod \"konnectivity-agent-zb5c2\" (UID: \"204eab9e-1b40-45f5-be0d-1fd142340ac9\") " pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.531114    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.534081    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.534106    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.534129    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:37.534215    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:40:38.034179496 +0000 UTC m=+2.033211372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.534618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8zwq\" (UniqueName: \"kubernetes.io/projected/47dc235e-43e7-48c9-8d3d-473816e01efc-kube-api-access-z8zwq\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.536343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjpx2\" (UniqueName: \"kubernetes.io/projected/8d66373d-40f1-4521-aa76-1c34b8406d1c-kube-api-access-tjpx2\") pod \"node-ca-8m4ms\" (UID: \"8d66373d-40f1-4521-aa76-1c34b8406d1c\") " pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.613838 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.536569    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2gs\" (UniqueName: \"kubernetes.io/projected/fbc9984e-1cce-47e8-b41f-7db5814eddbb-kube-api-access-bf2gs\") pod \"iptables-alerter-4zwpz\" (UID: \"fbc9984e-1cce-47e8-b41f-7db5814eddbb\") " pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.615106 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.537450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4bbn\" (UniqueName: \"kubernetes.io/projected/29e576c2-307d-446a-a3c8-3052ff265beb-kube-api-access-h4bbn\") pod \"tuned-crld6\" (UID: \"29e576c2-307d-446a-a3c8-3052ff265beb\") " pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.615106 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.540036    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2q8\" (UniqueName: \"kubernetes.io/projected/3ba2d7a3-087b-4395-bec7-2b44def67046-kube-api-access-wz2q8\") pod \"ovnkube-node-7fclh\" (UID: \"3ba2d7a3-087b-4395-bec7-2b44def67046\") " pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.615106 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.540145    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.638072    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662"
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.638152    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ac39ebd4fa4a02fa3ca1bc0e53b517.slice/crio-7aec21c844ae36cb57162eaf0bddc2facd8f28d4c02eda1f7dab70c778a685af WatchSource:0}: Error finding container 7aec21c844ae36cb57162eaf0bddc2facd8f28d4c02eda1f7dab70c778a685af: Status 404 returned error can't find the container with id 7aec21c844ae36cb57162eaf0bddc2facd8f28d4c02eda1f7dab70c778a685af
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.644239    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.647260    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955fa79b_cb4a_41ac_bdd0_3496afb0c014.slice/crio-c86591496fb80e189df2ea2e11962848d88a052500e27b688a090b280e579cc6 WatchSource:0}: Error finding container c86591496fb80e189df2ea2e11962848d88a052500e27b688a090b280e579cc6: Status 404 returned error can't find the container with id c86591496fb80e189df2ea2e11962848d88a052500e27b688a090b280e579cc6
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.657408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kmf9r"
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.666953    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd44e71_7096_4513_9215_4432fb3bb979.slice/crio-531429b585d86ac52d2af85c115efe6146fffe355da2cef791dc53bcde86ad61 WatchSource:0}: Error finding container 531429b585d86ac52d2af85c115efe6146fffe355da2cef791dc53bcde86ad61: Status 404 returned error can't find the container with id 531429b585d86ac52d2af85c115efe6146fffe355da2cef791dc53bcde86ad61
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.677709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qv2x5"
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.685758    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f1bf03_b72f_4618_8beb_0ead64957375.slice/crio-313061ec2bc17e981ed6e40bc5725c4b2239563b8edc5e757eb9cb716687fa00 WatchSource:0}: Error finding container 313061ec2bc17e981ed6e40bc5725c4b2239563b8edc5e757eb9cb716687fa00: Status 404 returned error can't find the container with id 313061ec2bc17e981ed6e40bc5725c4b2239563b8edc5e757eb9cb716687fa00
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.705590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sprk4"
Jul 16 13:40:37.741940 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.715254    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53e301e_013f_4314_809e_4cad5c5d64c0.slice/crio-f9effdd0338239743e3ce0da715303efe1cee555585b2cb41e597b1bbb1d6bf8 WatchSource:0}: Error finding container f9effdd0338239743e3ce0da715303efe1cee555585b2cb41e597b1bbb1d6bf8: Status 404 returned error can't find the container with id f9effdd0338239743e3ce0da715303efe1cee555585b2cb41e597b1bbb1d6bf8
Jul 16 13:40:37.748032 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.747854    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.761354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4zwpz"
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.769172    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc9984e_1cce_47e8_b41f_7db5814eddbb.slice/crio-2e31cd430789b025be2657351b330148336a4a6ed8b092ec2b789d50f1470fa7 WatchSource:0}: Error finding container 2e31cd430789b025be2657351b330148336a4a6ed8b092ec2b789d50f1470fa7: Status 404 returned error can't find the container with id 2e31cd430789b025be2657351b330148336a4a6ed8b092ec2b789d50f1470fa7
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.782274    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.806046    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-crld6"
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:37.834904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8m4ms"
Jul 16 13:40:37.888762 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.842901    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d66373d_40f1_4521_aa76_1c34b8406d1c.slice/crio-11af42b2bf7db555ea5b9e168c0127d62e70c43315a5913804dc8e55921c216e WatchSource:0}: Error finding container 11af42b2bf7db555ea5b9e168c0127d62e70c43315a5913804dc8e55921c216e: Status 404 returned error can't find the container with id 11af42b2bf7db555ea5b9e168c0127d62e70c43315a5913804dc8e55921c216e
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:40:37.903999    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba2d7a3_087b_4395_bec7_2b44def67046.slice/crio-62e1461938a472295c9025bbd5cc5a00c5ad0020a8d4c68e58115bccde7e1c81 WatchSource:0}: Error finding container 62e1461938a472295c9025bbd5cc5a00c5ad0020a8d4c68e58115bccde7e1c81: Status 404 returned error can't find the container with id 62e1461938a472295c9025bbd5cc5a00c5ad0020a8d4c68e58115bccde7e1c81
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.030236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.030277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.030333    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.030371    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.030401    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:40:39.030381415 +0000 UTC m=+3.029413286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:38.039641 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.030422    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:40:39.030412692 +0000 UTC m=+3.029444547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:38.141011 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.131127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:38.141011 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.131429    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:38.141011 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.131452    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:38.141011 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.131467    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:38.141011 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.131548    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:40:39.131526985 +0000 UTC m=+3.130558844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:38.365716 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.365639    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 13:35:37 +0000 UTC" deadline="2028-02-28 19:40:30.247903873 +0000 UTC"
Jul 16 13:40:38.365716 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.365714    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14213h59m51.882193627s"
Jul 16 13:40:38.503528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.503481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:38.503690 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.503649    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:38.504129 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.504111    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:38.504252 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:38.504232    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:38.520574 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.520461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"06ac39ebd4fa4a02fa3ca1bc0e53b517","Type":"ContainerStarted","Data":"7aec21c844ae36cb57162eaf0bddc2facd8f28d4c02eda1f7dab70c778a685af"}
Jul 16 13:40:38.531557 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.531523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"62e1461938a472295c9025bbd5cc5a00c5ad0020a8d4c68e58115bccde7e1c81"}
Jul 16 13:40:38.537625 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.537591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8m4ms" event={"ID":"8d66373d-40f1-4521-aa76-1c34b8406d1c","Type":"ContainerStarted","Data":"11af42b2bf7db555ea5b9e168c0127d62e70c43315a5913804dc8e55921c216e"}
Jul 16 13:40:38.552457 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.552405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zb5c2" event={"ID":"204eab9e-1b40-45f5-be0d-1fd142340ac9","Type":"ContainerStarted","Data":"13e76949764cd58e702615a3ed67ba6ef45bd93f763c922280d1c29c9589f80c"}
Jul 16 13:40:38.558302 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.558178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sprk4" event={"ID":"e53e301e-013f-4314-809e-4cad5c5d64c0","Type":"ContainerStarted","Data":"f9effdd0338239743e3ce0da715303efe1cee555585b2cb41e597b1bbb1d6bf8"}
Jul 16 13:40:38.575968 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.575938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kmf9r" event={"ID":"9bd44e71-7096-4513-9215-4432fb3bb979","Type":"ContainerStarted","Data":"531429b585d86ac52d2af85c115efe6146fffe355da2cef791dc53bcde86ad61"}
Jul 16 13:40:38.590767 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.590732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662" event={"ID":"955fa79b-cb4a-41ac-bdd0-3496afb0c014","Type":"ContainerStarted","Data":"c86591496fb80e189df2ea2e11962848d88a052500e27b688a090b280e579cc6"}
Jul 16 13:40:38.595700 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.595677    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 13:40:38.604366 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.604304    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"2a4b96753b88ae6c42256558ecb1e9d2","Type":"ContainerStarted","Data":"d9c0a43b0c7d6bb46c61c863d2ffa820d25808e68568174c0d6a6e68c56bab3c"}
Jul 16 13:40:38.613279 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.613248    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crld6" event={"ID":"29e576c2-307d-446a-a3c8-3052ff265beb","Type":"ContainerStarted","Data":"8a58201a4495e00975f01a5033c75f6cfb0eead85d890a31803d397a7c4251e4"}
Jul 16 13:40:38.631092 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.630376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zwpz" event={"ID":"fbc9984e-1cce-47e8-b41f-7db5814eddbb","Type":"ContainerStarted","Data":"2e31cd430789b025be2657351b330148336a4a6ed8b092ec2b789d50f1470fa7"}
Jul 16 13:40:38.642137 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:38.642031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerStarted","Data":"313061ec2bc17e981ed6e40bc5725c4b2239563b8edc5e757eb9cb716687fa00"}
Jul 16 13:40:39.038627 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.038544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:39.038786 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.038663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:39.038786 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.038779    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:39.038951 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.038839    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:40:41.038821244 +0000 UTC m=+5.037853101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:39.039242 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.039223    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:39.039306 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.039278    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:40:41.039261976 +0000 UTC m=+5.038293836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:39.139119 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.139076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:39.139820 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.139283    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:39.139820 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.139310    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:39.139820 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.139323    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:39.139820 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.139380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:40:41.13936193 +0000 UTC m=+5.138393789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:39.365979 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.365870    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 13:35:37 +0000 UTC" deadline="2027-12-14 00:14:55.446788773 +0000 UTC"
Jul 16 13:40:39.365979 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.365932    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12370h34m16.080860219s"
Jul 16 13:40:39.503461 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:39.503425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:39.503664 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:39.503598    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:40.503776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:40.503748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:40.504259 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:40.503883    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:40.504823 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:40.504653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:40.504823 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:40.504764    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:41.056643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:41.056693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.056884    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.056951    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:40:45.056931459 +0000 UTC m=+9.055963323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.057357    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:41.057580 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.057408    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:40:45.057393284 +0000 UTC m=+9.056425141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:41.157945 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:41.157909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:41.158136 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.158095    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:41.158136 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.158120    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:41.158136 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.158132    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:41.158293 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.158189    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:40:45.158171242 +0000 UTC m=+9.157203112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:41.503920 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:41.503378    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:41.503920 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:41.503525    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:42.503707 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:42.503670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:42.503887 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:42.503800    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:42.504226 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:42.504205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:42.504579 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:42.504319    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:43.503541 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:43.503501    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:43.503719 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:43.503632    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:44.503538 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:44.503433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:44.503957 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:44.503590    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:44.503957 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:44.503763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:44.503957 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:44.503891    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:45.092534 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:45.092478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:45.092695 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:45.092570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:45.092695 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.092625    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:45.092812 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.092702    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:40:53.092680814 +0000 UTC m=+17.091712692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:45.092812 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.092716    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:45.092812 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.092788    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:40:53.092770974 +0000 UTC m=+17.091802832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:45.193154 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:45.193068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:45.193336 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.193245    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:45.193336 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.193277    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:45.193336 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.193292    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:45.193535 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.193367    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:40:53.193343396 +0000 UTC m=+17.192375254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:45.503829 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:45.503743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:45.504412 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:45.503893    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:46.504584 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:46.504533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:46.505156 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:46.504663    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:46.505156 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:46.505008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:46.505156 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:46.505090    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:47.503420 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:47.503333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:47.503600 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:47.503479    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:48.503918 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:48.503890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:48.504380 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:48.503890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:48.504380 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:48.503999    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:48.504380 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:48.504107    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:49.503929 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:49.503705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:49.504072 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:49.503968    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:50.503468 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:50.503432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:50.503660 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:50.503437    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:50.503660 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:50.503582    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:50.503767 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:50.503746    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:51.503631 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:51.503597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:51.504071 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:51.503732    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:52.503850 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:52.503812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:52.504277 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:52.503812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:52.504277 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:52.503928    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:52.504277 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:52.504052    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:53.153586 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:53.153552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:53.153586 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:53.153589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:53.153793 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.153714    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:53.153793 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.153715    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:53.153793 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.153775    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:41:09.153758196 +0000 UTC m=+33.152790050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:40:53.153793 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.153792    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:09.153785034 +0000 UTC m=+33.152816890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:40:53.254136 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:53.254051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:53.254290 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.254183    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:40:53.254290 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.254204    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:40:53.254290 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.254215    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:53.254290 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.254267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:41:09.254252324 +0000 UTC m=+33.253284181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:40:53.503410 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:53.503377    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:53.503599 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:53.503530    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:54.503271 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:54.503233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:54.503271 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:54.503262    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:54.503784 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:54.503397    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:54.503784 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:54.503552    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:55.503902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:55.503866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:55.504326 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:55.503987    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:56.504079 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:56.504048    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:56.504579 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:56.504112    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:56.504579 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:56.504128    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:56.504579 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:56.504221    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:57.503684 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:57.503659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:57.503806 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:57.503753    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:58.504010 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.503577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:40:58.504533 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.503657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:40:58.504533 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:58.504093    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:40:58.504533 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:58.504190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:40:58.687210 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.687170    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zb5c2" event={"ID":"204eab9e-1b40-45f5-be0d-1fd142340ac9","Type":"ContainerStarted","Data":"aeea6234f6965bc2f9275593d6f7cb169734d34fc743359298e6a74257c0df96"}
Jul 16 13:40:58.688706 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.688677    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sprk4" event={"ID":"e53e301e-013f-4314-809e-4cad5c5d64c0","Type":"ContainerStarted","Data":"3bdc2bdcec4a245d4345aafd0484161c96f88c917e45e3872db4e661d61ecdd4"}
Jul 16 13:40:58.690093 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.690069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kmf9r" event={"ID":"9bd44e71-7096-4513-9215-4432fb3bb979","Type":"ContainerStarted","Data":"295af0fdd03a8ee449d340069b1903e0c4bc51a47a833ef01c0ff9abef59d2bf"}
Jul 16 13:40:58.691532 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.691508    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662" event={"ID":"955fa79b-cb4a-41ac-bdd0-3496afb0c014","Type":"ContainerStarted","Data":"808f708fbc278ddf64396c134a94d725aca9613944f062ec806b4a46ec68386b"}
Jul 16 13:40:58.692840 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.692820    2558 generic.go:356] "Generic (PLEG): container finished" podID="2a4b96753b88ae6c42256558ecb1e9d2" containerID="9776ada9c4ef7dbb2ae19aa2e0fe46480df6c3e9e7716153b3e8a46e5e573103" exitCode=0
Jul 16 13:40:58.692929 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.692898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"2a4b96753b88ae6c42256558ecb1e9d2","Type":"ContainerDied","Data":"9776ada9c4ef7dbb2ae19aa2e0fe46480df6c3e9e7716153b3e8a46e5e573103"}
Jul 16 13:40:58.695936 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.695912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-crld6" event={"ID":"29e576c2-307d-446a-a3c8-3052ff265beb","Type":"ContainerStarted","Data":"aa4db7300381a18c5397df7c1085a2563050dea4585a396ea0be8479c50197f4"}
Jul 16 13:40:58.697657 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.697632    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="c9eb6cb2d3ff1b0b0532c261350e96c25006a85adef50c2851593a3d49b52302" exitCode=0
Jul 16 13:40:58.697741 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.697714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"c9eb6cb2d3ff1b0b0532c261350e96c25006a85adef50c2851593a3d49b52302"}
Jul 16 13:40:58.699089 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.699072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" event={"ID":"06ac39ebd4fa4a02fa3ca1bc0e53b517","Type":"ContainerStarted","Data":"5c4b59451507a87bdd543d73b888429ea016ec12b4a3c44287e1b026042c7dff"}
Jul 16 13:40:58.701782 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.701766    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:40:58.702121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702096    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ba2d7a3-087b-4395-bec7-2b44def67046" containerID="f56351c7e353eb82ab30ca23a79d49f3cbc9e3d85a22059260a52ecb528f8b0b" exitCode=1
Jul 16 13:40:58.702121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"5bfc14f9de392b7409a331cb00229359461a6345195aa772dadbf8aed21eb540"}
Jul 16 13:40:58.702256 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702169    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"94008925ce2dad1f5623b3d58938d686234072793e8c788fc6779c12cdf09bb0"}
Jul 16 13:40:58.702256 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702200    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"e351d361ae0ef1b25c8ab3d882063b894e9b33738c121852c66c129fae45effd"}
Jul 16 13:40:58.702256 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"36728b99af17790a7848d3e5fb72a85fdb22343d09dc1f9772d8e58990e41dbd"}
Jul 16 13:40:58.702401 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerDied","Data":"f56351c7e353eb82ab30ca23a79d49f3cbc9e3d85a22059260a52ecb528f8b0b"}
Jul 16 13:40:58.702401 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.702294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"9655be9077634e75c3f72b223b3f0ee36b8cf7506973a0c1187df0c8e4765f89"}
Jul 16 13:40:58.703504 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.703458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8m4ms" event={"ID":"8d66373d-40f1-4521-aa76-1c34b8406d1c","Type":"ContainerStarted","Data":"5ab67104e1f71510979f34eb9f518a571f8d8cfc176f7afe50ba97fd746838ce"}
Jul 16 13:40:58.713091 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.713045    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zb5c2" podStartSLOduration=7.598924546 podStartE2EDuration="22.71303431s" totalImagesPullingTime="15.114109764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.712911135 +0000 UTC m=+22.711943013" watchObservedRunningTime="2026-07-16 13:40:58.71303431 +0000 UTC m=+22.712066186"
Jul 16 13:40:58.754827 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.754739    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-62.ec2.internal" podStartSLOduration=21.754718151 podStartE2EDuration="21.754718151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.753959874 +0000 UTC m=+22.752991754" watchObservedRunningTime="2026-07-16 13:40:58.754718151 +0000 UTC m=+22.753750029"
Jul 16 13:40:58.771763 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.771721    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kmf9r" podStartSLOduration=2.756150341 podStartE2EDuration="22.771708273s" totalImagesPullingTime="20.015557932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.771445772 +0000 UTC m=+22.770477639" watchObservedRunningTime="2026-07-16 13:40:58.771708273 +0000 UTC m=+22.770740149"
Jul 16 13:40:58.818990 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.818947    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sprk4" podStartSLOduration=2.743448292 podStartE2EDuration="22.818933949s" totalImagesPullingTime="20.075485657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.818531144 +0000 UTC m=+22.817563042" watchObservedRunningTime="2026-07-16 13:40:58.818933949 +0000 UTC m=+22.817965825"
Jul 16 13:40:58.837796 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.837752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-crld6" podStartSLOduration=2.968859188 podStartE2EDuration="22.83773654s" totalImagesPullingTime="19.868877352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.837448617 +0000 UTC m=+22.836480487" watchObservedRunningTime="2026-07-16 13:40:58.83773654 +0000 UTC m=+22.836768420"
Jul 16 13:40:58.859873 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:58.859830    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8m4ms" podStartSLOduration=3.02085653 podStartE2EDuration="22.859816412s" totalImagesPullingTime="19.838959882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:58.859740861 +0000 UTC m=+22.858772737" watchObservedRunningTime="2026-07-16 13:40:58.859816412 +0000 UTC m=+22.858848290"
Jul 16 13:40:59.503879 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:59.503802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:40:59.504213 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:40:59.503946    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:40:59.708309 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:59.708266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" event={"ID":"2a4b96753b88ae6c42256558ecb1e9d2","Type":"ContainerStarted","Data":"c83f4d1d4b2a7c405a4018fda6d7158afa89f6f2af1039a42e7fc3ecb07c35a2"}
Jul 16 13:40:59.710180 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:59.710092    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4zwpz" event={"ID":"fbc9984e-1cce-47e8-b41f-7db5814eddbb","Type":"ContainerStarted","Data":"aa01c6c1af6001de78591617dc72df10edb52c52074ed1b48ff8f32b8177ae5a"}
Jul 16 13:40:59.724104 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:59.724049    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-62.ec2.internal" podStartSLOduration=22.724031741 podStartE2EDuration="22.724031741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:59.723912591 +0000 UTC m=+23.722944489" watchObservedRunningTime="2026-07-16 13:40:59.724031741 +0000 UTC m=+23.723063619"
Jul 16 13:40:59.739725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:40:59.739672    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4zwpz" podStartSLOduration=3.826775897 podStartE2EDuration="23.739655666s" totalImagesPullingTime="19.912879769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:40:59.739467745 +0000 UTC m=+23.738499622" watchObservedRunningTime="2026-07-16 13:40:59.739655666 +0000 UTC m=+23.738687544"
Jul 16 13:41:00.503789 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:00.503757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:00.504122 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:00.503741    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:00.504122 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:00.503877    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:00.504122 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:00.504017    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:00.819465 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:00.819427    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 13:41:01.403553 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.403439    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T13:41:00.81945784Z","UUID":"c5a33ac6-0025-4ca4-b624-08391a29d247","Handler":null,"Name":"","Endpoint":""}
Jul 16 13:41:01.405075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.405049    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 13:41:01.405213 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.405088    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 13:41:01.504278 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.504248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:01.504670 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:01.504363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:41:01.717863 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.717788    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:41:01.718250 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.718222    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"dae90e8b72093e0c9133ff3d8aeff1e1e1fbc96938eee7383de372c8a3f732e5"}
Jul 16 13:41:01.720126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:01.720096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662" event={"ID":"955fa79b-cb4a-41ac-bdd0-3496afb0c014","Type":"ContainerStarted","Data":"dd96cb038096bda76a54eb1b81ba730a2543b84928cf4d8f729f62b12de70800"}
Jul 16 13:41:02.150530 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:02.150292    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:41:02.151084 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:02.151063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:41:02.503791 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:02.503723    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:02.503952 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:02.503848    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:02.503952 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:02.503910    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:02.504045 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:02.504009    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:03.503155 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.503122    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:03.503838 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:03.503227    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:41:03.725774 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.725589    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="aeed2b9f47d6f9b6b2500e07a5a6758e5c1bfa0ed7c618da7b462e48eea1833c" exitCode=0
Jul 16 13:41:03.725949 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.725675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"aeed2b9f47d6f9b6b2500e07a5a6758e5c1bfa0ed7c618da7b462e48eea1833c"}
Jul 16 13:41:03.729233 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.729215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:41:03.729625 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.729602    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"9f2eb7ac228192fa52d464ec5267ca1c67e1c006f9a13ae690bf4d69862066d2"}
Jul 16 13:41:03.729845 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.729825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:03.729957 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.729893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:03.730005 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.729968    2558 scope.go:117] "RemoveContainer" containerID="f56351c7e353eb82ab30ca23a79d49f3cbc9e3d85a22059260a52ecb528f8b0b"
Jul 16 13:41:03.751665 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:03.751644    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:04.504098 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.504068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:04.504620 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.504070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:04.504620 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:04.504208    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:04.504620 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:04.504315    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:04.734942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.734915    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:41:04.735301 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.735279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" event={"ID":"3ba2d7a3-087b-4395-bec7-2b44def67046","Type":"ContainerStarted","Data":"40c514dc78d9de390c129c92cba66179b9b4d8c5af8dac45445c480b38c8fb0c"}
Jul 16 13:41:04.735470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.735451    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:04.751529 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.751507    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:04.763044 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.762996    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh" podStartSLOduration=8.941172389 podStartE2EDuration="28.762980998s" totalImagesPullingTime="19.821808609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:04.761215219 +0000 UTC m=+28.760247110" watchObservedRunningTime="2026-07-16 13:41:04.762980998 +0000 UTC m=+28.762012875"
Jul 16 13:41:04.788901 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.788868    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:41:04.789071 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.789010    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 13:41:04.789456 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.789435    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zb5c2"
Jul 16 13:41:04.850334 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.850302    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4vfc"]
Jul 16 13:41:04.850544 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.850453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:04.850616 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:04.850581    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:41:04.858337 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.858303    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46lgl"]
Jul 16 13:41:04.858523 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.858432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:04.858618 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:04.858556    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:04.859160 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.859132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-726ml"]
Jul 16 13:41:04.859259 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:04.859245    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:04.859399 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:04.859349    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:05.739944 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:05.739908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662" event={"ID":"955fa79b-cb4a-41ac-bdd0-3496afb0c014","Type":"ContainerStarted","Data":"dbb0ca2c837ac616452a441ea77bfab77a2b765f3a9585b1227dcad1d39aae66"}
Jul 16 13:41:05.760211 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:05.760168    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gj662" podStartSLOduration=2.793138828 podStartE2EDuration="29.760151515s" totalImagesPullingTime="26.967012687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:05.75965679 +0000 UTC m=+29.758688669" watchObservedRunningTime="2026-07-16 13:41:05.760151515 +0000 UTC m=+29.759183370"
Jul 16 13:41:06.504031 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:06.503847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:06.504179 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:06.503914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:06.504179 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:06.504094    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:06.504251 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:06.503933    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:06.504283 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:06.504181    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:41:06.504315 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:06.504294    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:06.743917 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:06.743834    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="55bc415fb19b5272fe8eab6c726cfbe8a5533b081f52d8cda6e4d874b8bf6fa3" exitCode=0
Jul 16 13:41:06.744288 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:06.743917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"55bc415fb19b5272fe8eab6c726cfbe8a5533b081f52d8cda6e4d874b8bf6fa3"}
Jul 16 13:41:07.748389 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:07.748318    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="145c37c1b10860a3cb923af42899957839e1e89e286df84aa60e5e8c520f2e99" exitCode=0
Jul 16 13:41:07.748389 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:07.748368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"145c37c1b10860a3cb923af42899957839e1e89e286df84aa60e5e8c520f2e99"}
Jul 16 13:41:08.504205 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:08.504021    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:08.504391 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:08.504032    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:08.504391 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:08.504325    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-726ml" podUID="47dc235e-43e7-48c9-8d3d-473816e01efc"
Jul 16 13:41:08.504522 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:08.504404    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4vfc" podUID="66c55ac9-cb12-429a-b72c-7ac948ed30a6"
Jul 16 13:41:08.504522 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:08.504083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:08.504522 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:08.504513    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46lgl" podUID="99eded7b-b614-4ec7-a05b-ddb14d0c9d2a"
Jul 16 13:41:09.162752 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:09.162720    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:09.163150 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:09.162762    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:09.163150 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.162885    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:41:09.163150 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.162897    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 13:41:09.163150 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.162948    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:41:41.162929266 +0000 UTC m=+65.161961121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 13:41:09.163150 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.162965    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret podName:66c55ac9-cb12-429a-b72c-7ac948ed30a6 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:41.162958176 +0000 UTC m=+65.161990031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret") pod "global-pull-secret-syncer-n4vfc" (UID: "66c55ac9-cb12-429a-b72c-7ac948ed30a6") : object "kube-system"/"original-pull-secret" not registered
Jul 16 13:41:09.263661 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:09.263564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:09.263828 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.263713    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 13:41:09.263828 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.263740    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 13:41:09.263828 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.263754    2558 projected.go:196] Error preparing data for projected volume kube-api-access-kzhcp for pod openshift-network-diagnostics/network-check-target-46lgl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:41:09.263828 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:09.263820    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp podName:99eded7b-b614-4ec7-a05b-ddb14d0c9d2a nodeName:}" failed. No retries permitted until 2026-07-16 13:41:41.263801131 +0000 UTC m=+65.262832990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzhcp" (UniqueName: "kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp") pod "network-check-target-46lgl" (UID: "99eded7b-b614-4ec7-a05b-ddb14d0c9d2a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 13:41:10.308783 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.308758    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-62.ec2.internal" event="NodeReady"
Jul 16 13:41:10.309219 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.308924    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 13:41:10.352818 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.352785    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xr8t4"]
Jul 16 13:41:10.357853 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.357830    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mkrf5"]
Jul 16 13:41:10.357997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.357975    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.360501 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.360467    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 13:41:10.360667 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.360539    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 13:41:10.360766 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.360752    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xfg5g\""
Jul 16 13:41:10.361336 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.361317    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.363742 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.363702    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 13:41:10.363742 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.363721    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 13:41:10.363908 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.363760    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 13:41:10.363908 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.363823    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6q5v4\""
Jul 16 13:41:10.367376 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.367352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xr8t4"]
Jul 16 13:41:10.370049 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.370028    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkrf5"]
Jul 16 13:41:10.471605 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7p2r\" (UniqueName: \"kubernetes.io/projected/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-kube-api-access-s7p2r\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.471757 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471619    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpg2z\" (UniqueName: \"kubernetes.io/projected/a799d138-cd10-44b0-bdc7-94d8be95575c-kube-api-access-cpg2z\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.471757 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-config-volume\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.471757 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a799d138-cd10-44b0-bdc7-94d8be95575c-cert\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.471880 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.471880 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.471820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-tmp-dir\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.503786 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.503699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:10.503950 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.503699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:10.503950 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.503699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:10.508030 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.507866    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 13:41:10.508030 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.507877    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6lhsq\""
Jul 16 13:41:10.508030 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.507890    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 13:41:10.508278 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.508052    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cxrw\""
Jul 16 13:41:10.508278 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.508123    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 13:41:10.508278 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.508206    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 13:41:10.572559 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.572709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-tmp-dir\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.572709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572604    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7p2r\" (UniqueName: \"kubernetes.io/projected/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-kube-api-access-s7p2r\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.572709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpg2z\" (UniqueName: \"kubernetes.io/projected/a799d138-cd10-44b0-bdc7-94d8be95575c-kube-api-access-cpg2z\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.572709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-config-volume\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.572709 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:10.572702    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:10.572992 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:10.572791    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:11.072769503 +0000 UTC m=+35.071801389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:10.572992 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.572706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a799d138-cd10-44b0-bdc7-94d8be95575c-cert\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.573096 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.573015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-tmp-dir\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.573448 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.573422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-config-volume\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.577446 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.577428    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a799d138-cd10-44b0-bdc7-94d8be95575c-cert\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.582041 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.582019    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpg2z\" (UniqueName: \"kubernetes.io/projected/a799d138-cd10-44b0-bdc7-94d8be95575c-kube-api-access-cpg2z\") pod \"ingress-canary-mkrf5\" (UID: \"a799d138-cd10-44b0-bdc7-94d8be95575c\") " pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:10.582160 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.582140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7p2r\" (UniqueName: \"kubernetes.io/projected/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-kube-api-access-s7p2r\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:10.677946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:10.677911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkrf5"
Jul 16 13:41:11.076620 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:11.076580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:11.076783 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:11.076762    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:11.076858 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:11.076844    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:12.076823165 +0000 UTC m=+36.075855027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:11.739703 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:11.739674    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkrf5"]
Jul 16 13:41:11.742939 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:11.742909    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda799d138_cd10_44b0_bdc7_94d8be95575c.slice/crio-28e02bc58cd04d3b57823f405b9ba1f8210d6d8973f23ab333bed2bbbee6d579 WatchSource:0}: Error finding container 28e02bc58cd04d3b57823f405b9ba1f8210d6d8973f23ab333bed2bbbee6d579: Status 404 returned error can't find the container with id 28e02bc58cd04d3b57823f405b9ba1f8210d6d8973f23ab333bed2bbbee6d579
Jul 16 13:41:11.759111 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:11.759089    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkrf5" event={"ID":"a799d138-cd10-44b0-bdc7-94d8be95575c","Type":"ContainerStarted","Data":"28e02bc58cd04d3b57823f405b9ba1f8210d6d8973f23ab333bed2bbbee6d579"}
Jul 16 13:41:12.084007 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:12.083820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:12.084172 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:12.083976    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:12.084172 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:12.084092    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:14.08407837 +0000 UTC m=+38.083110225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:12.765279 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:12.765239    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="b4f462759582a99bf0e7624b03261ab11119278c187cce5341f39d06f59b6c91" exitCode=0
Jul 16 13:41:12.765773 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:12.765291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"b4f462759582a99bf0e7624b03261ab11119278c187cce5341f39d06f59b6c91"}
Jul 16 13:41:13.771568 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:13.771529    2558 generic.go:356] "Generic (PLEG): container finished" podID="f9f1bf03-b72f-4618-8beb-0ead64957375" containerID="31c46233f3413c3115c36f2f60a569a72cee96eb3ad1f1f18f306a8845f46723" exitCode=0
Jul 16 13:41:13.772008 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:13.771615    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerDied","Data":"31c46233f3413c3115c36f2f60a569a72cee96eb3ad1f1f18f306a8845f46723"}
Jul 16 13:41:14.099052 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:14.099002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:14.099198 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:14.099174    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:14.099266 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:14.099255    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:18.099235852 +0000 UTC m=+42.098267729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:14.777806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:14.777758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" event={"ID":"f9f1bf03-b72f-4618-8beb-0ead64957375","Type":"ContainerStarted","Data":"4cfa0bf633a33cd22cb397f5b5427f3ba6081dbd9957e459b76dc1f6d637fe09"}
Jul 16 13:41:14.779237 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:14.779207    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkrf5" event={"ID":"a799d138-cd10-44b0-bdc7-94d8be95575c","Type":"ContainerStarted","Data":"00ce7f67fdac3ef8ec4715381f351b5bf853ffd48cb6bc60616bffc69ad43ad8"}
Jul 16 13:41:14.799999 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:14.799944    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qv2x5" podStartSLOduration=7.50285094 podStartE2EDuration="38.799929391s" totalImagesPullingTime="31.297078451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:14.79883897 +0000 UTC m=+38.797870846" watchObservedRunningTime="2026-07-16 13:41:14.799929391 +0000 UTC m=+38.798961267"
Jul 16 13:41:14.813471 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:14.813409    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mkrf5" podStartSLOduration=2.002436115 podStartE2EDuration="4.813387636s" totalImagesPullingTime="2.810951521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:14.813050651 +0000 UTC m=+38.812082528" watchObservedRunningTime="2026-07-16 13:41:14.813387636 +0000 UTC m=+38.812419516"
Jul 16 13:41:18.129355 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:18.129316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:18.129833 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:18.129474    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:18.129833 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:18.129565    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:26.129548514 +0000 UTC m=+50.128580368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:26.186170 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:26.186137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:26.186650 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:26.186265    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:26.186650 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:26.186324    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:41:42.186311288 +0000 UTC m=+66.185343143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:32.049805 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.049766    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q9prr"]
Jul 16 13:41:32.051876 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.051861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.054313 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.054290    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 13:41:32.054420 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.054335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 13:41:32.054816 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.054800    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 13:41:32.055560 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.055545    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ztw2f\""
Jul 16 13:41:32.055614 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.055595    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 13:41:32.060221 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.060203    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 13:41:32.068769 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.068748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q9prr"]
Jul 16 13:41:32.153750 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.153718    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:41:32.155806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.155785    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.159335 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.159315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 13:41:32.159439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.159333    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xfh2z\""
Jul 16 13:41:32.160688 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.160670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 13:41:32.160935 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.160919    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 13:41:32.168831 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.167823    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 13:41:32.175431 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.175409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:41:32.227728 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227700    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-tmp\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.227905 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.227905 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227777    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.227905 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-serving-cert\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.228007 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblwc\" (UniqueName: \"kubernetes.io/projected/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-kube-api-access-vblwc\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.228007 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.227956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-snapshots\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.328914 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.328873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.328930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-serving-cert\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.328971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblwc\" (UniqueName: \"kubernetes.io/projected/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-kube-api-access-vblwc\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.328991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329287 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329287 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-snapshots\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329287 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329287 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpg9\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329287 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329558 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-tmp\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329558 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329399    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329558 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.329829 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-tmp\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-snapshots\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329971 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.329971 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.329951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.332425 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.332406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-serving-cert\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.337205 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.337182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblwc\" (UniqueName: \"kubernetes.io/projected/8fe5b7bc-0a11-4a86-b7eb-c71e746a9575-kube-api-access-vblwc\") pod \"insights-operator-68d9dd94cf-q9prr\" (UID: \"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575\") " pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.362121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.362099    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr"
Jul 16 13:41:32.377126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.377106    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-s7kst"]
Jul 16 13:41:32.379326 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.379313    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.383415 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.383391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 13:41:32.385051 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.385023    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 13:41:32.385153 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.385101    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 13:41:32.385211 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.385182    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 13:41:32.385473 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.385438    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pzhpp\""
Jul 16 13:41:32.390815 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.390793    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 13:41:32.393619 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.393599    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-s7kst"]
Jul 16 13:41:32.430039 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430163 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpg9\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430163 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430163 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430328 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430328 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430328 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430328 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430306    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430533 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.430325    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.430533 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.430407    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 13:41:32.430533 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.430420    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c6d5cf898-qs9s2: secret "image-registry-tls" not found
Jul 16 13:41:32.430533 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.430472    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls podName:681e7bea-d4f0-41b5-be02-ce3971cd9e04 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:32.930456871 +0000 UTC m=+56.929488725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls") pod "image-registry-c6d5cf898-qs9s2" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04") : secret "image-registry-tls" not found
Jul 16 13:41:32.431165 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.431129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.431669 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.431651    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.433415 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.433395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.433611 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.433595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.439030 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.439005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.439113 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.439077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpg9\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.484291 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.484260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-q9prr"]
Jul 16 13:41:32.487457 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:32.487432    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe5b7bc_0a11_4a86_b7eb_c71e746a9575.slice/crio-748c0db8ebf3e922e9642c27a25658967e1c368b6ce1c67b1ccefe14cd7ba689 WatchSource:0}: Error finding container 748c0db8ebf3e922e9642c27a25658967e1c368b6ce1c67b1ccefe14cd7ba689: Status 404 returned error can't find the container with id 748c0db8ebf3e922e9642c27a25658967e1c368b6ce1c67b1ccefe14cd7ba689
Jul 16 13:41:32.531067 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.531041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-config\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.531190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.531073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f6128d3-c018-4e00-b2d9-f7b61acfede3-serving-cert\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.531190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.531097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-trusted-ca\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.531190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.531123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzjv\" (UniqueName: \"kubernetes.io/projected/7f6128d3-c018-4e00-b2d9-f7b61acfede3-kube-api-access-6fzjv\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.631862 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.631777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f6128d3-c018-4e00-b2d9-f7b61acfede3-serving-cert\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.631990 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.631869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-trusted-ca\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.631990 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.631920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzjv\" (UniqueName: \"kubernetes.io/projected/7f6128d3-c018-4e00-b2d9-f7b61acfede3-kube-api-access-6fzjv\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.632060 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.632029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-config\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.632584 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.632557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-config\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.632701 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.632675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f6128d3-c018-4e00-b2d9-f7b61acfede3-trusted-ca\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.634135 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.634114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f6128d3-c018-4e00-b2d9-f7b61acfede3-serving-cert\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.640381 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.640363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzjv\" (UniqueName: \"kubernetes.io/projected/7f6128d3-c018-4e00-b2d9-f7b61acfede3-kube-api-access-6fzjv\") pod \"console-operator-7866497494-s7kst\" (UID: \"7f6128d3-c018-4e00-b2d9-f7b61acfede3\") " pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.689437 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.689403    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:32.817214 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.817184    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-s7kst"]
Jul 16 13:41:32.820238 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:32.820211    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f6128d3_c018_4e00_b2d9_f7b61acfede3.slice/crio-2d9f3b3e793b54b8fddefd18b6e8f890e8150acff816b492ece1dcff17f8d2af WatchSource:0}: Error finding container 2d9f3b3e793b54b8fddefd18b6e8f890e8150acff816b492ece1dcff17f8d2af: Status 404 returned error can't find the container with id 2d9f3b3e793b54b8fddefd18b6e8f890e8150acff816b492ece1dcff17f8d2af
Jul 16 13:41:32.822257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.822233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr" event={"ID":"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575","Type":"ContainerStarted","Data":"748c0db8ebf3e922e9642c27a25658967e1c368b6ce1c67b1ccefe14cd7ba689"}
Jul 16 13:41:32.935538 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:32.935436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:32.935690 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.935603    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 13:41:32.935690 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.935629    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c6d5cf898-qs9s2: secret "image-registry-tls" not found
Jul 16 13:41:32.935811 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:32.935698    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls podName:681e7bea-d4f0-41b5-be02-ce3971cd9e04 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:33.935674623 +0000 UTC m=+57.934706489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls") pod "image-registry-c6d5cf898-qs9s2" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04") : secret "image-registry-tls" not found
Jul 16 13:41:33.826004 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:33.825964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s7kst" event={"ID":"7f6128d3-c018-4e00-b2d9-f7b61acfede3","Type":"ContainerStarted","Data":"2d9f3b3e793b54b8fddefd18b6e8f890e8150acff816b492ece1dcff17f8d2af"}
Jul 16 13:41:33.945203 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:33.945165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:33.945371 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:33.945345    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 13:41:33.945371 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:33.945367    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c6d5cf898-qs9s2: secret "image-registry-tls" not found
Jul 16 13:41:33.945475 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:33.945434    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls podName:681e7bea-d4f0-41b5-be02-ce3971cd9e04 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:35.945412995 +0000 UTC m=+59.944444861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls") pod "image-registry-c6d5cf898-qs9s2" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04") : secret "image-registry-tls" not found
Jul 16 13:41:35.833058 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.833032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/0.log"
Jul 16 13:41:35.833571 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.833546    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f6128d3-c018-4e00-b2d9-f7b61acfede3" containerID="36003e01f650d618303b0b103d80714568836df1489123e055557c12c4b879c6" exitCode=255
Jul 16 13:41:35.833777 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.833758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s7kst" event={"ID":"7f6128d3-c018-4e00-b2d9-f7b61acfede3","Type":"ContainerDied","Data":"36003e01f650d618303b0b103d80714568836df1489123e055557c12c4b879c6"}
Jul 16 13:41:35.834216 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.834193    2558 scope.go:117] "RemoveContainer" containerID="36003e01f650d618303b0b103d80714568836df1489123e055557c12c4b879c6"
Jul 16 13:41:35.836211 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.836190    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr" event={"ID":"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575","Type":"ContainerStarted","Data":"8486587d64767b91b2e606a9a4596ab5e6b9f7ad3edaed83e0b275eb7020c51f"}
Jul 16 13:41:35.868828 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.868433    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr" podStartSLOduration=0.85033637 podStartE2EDuration="3.868415958s" totalImagesPullingTime="3.018079588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:35.867917172 +0000 UTC m=+59.866949110" watchObservedRunningTime="2026-07-16 13:41:35.868415958 +0000 UTC m=+59.867447836"
Jul 16 13:41:35.961198 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:35.961161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:35.961367 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:35.961325    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 13:41:35.961367 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:35.961349    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c6d5cf898-qs9s2: secret "image-registry-tls" not found
Jul 16 13:41:35.961465 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:35.961406    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls podName:681e7bea-d4f0-41b5-be02-ce3971cd9e04 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:39.961386005 +0000 UTC m=+63.960417860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls") pod "image-registry-c6d5cf898-qs9s2" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04") : secret "image-registry-tls" not found
Jul 16 13:41:36.361178 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.361146    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"]
Jul 16 13:41:36.363190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.363174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.365827 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.365808    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-msk5v\""
Jul 16 13:41:36.366138 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.366117    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 13:41:36.366183 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.366136    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 13:41:36.373473 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.373454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"]
Jul 16 13:41:36.465358 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.465322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32adff5f-4d40-4015-95bd-403c254c7b12-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.465561 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.465386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.566566 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.566538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32adff5f-4d40-4015-95bd-403c254c7b12-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.566735 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.566598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.566735 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:36.566722    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 13:41:36.566819 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:36.566780    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert podName:32adff5f-4d40-4015-95bd-403c254c7b12 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:37.066767999 +0000 UTC m=+61.065799853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wt2fl" (UID: "32adff5f-4d40-4015-95bd-403c254c7b12") : secret "networking-console-plugin-cert" not found
Jul 16 13:41:36.567144 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.567124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32adff5f-4d40-4015-95bd-403c254c7b12-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:36.755630 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.755551    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7fclh"
Jul 16 13:41:36.840608 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.840578    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:41:36.841005 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.840991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/0.log"
Jul 16 13:41:36.841065 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.841025    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f6128d3-c018-4e00-b2d9-f7b61acfede3" containerID="4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1" exitCode=255
Jul 16 13:41:36.841122 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.841064    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s7kst" event={"ID":"7f6128d3-c018-4e00-b2d9-f7b61acfede3","Type":"ContainerDied","Data":"4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1"}
Jul 16 13:41:36.841175 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.841119    2558 scope.go:117] "RemoveContainer" containerID="36003e01f650d618303b0b103d80714568836df1489123e055557c12c4b879c6"
Jul 16 13:41:36.841384 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:36.841367    2558 scope.go:117] "RemoveContainer" containerID="4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1"
Jul 16 13:41:36.841591 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:36.841570    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s7kst_openshift-console-operator(7f6128d3-c018-4e00-b2d9-f7b61acfede3)\"" pod="openshift-console-operator/console-operator-7866497494-s7kst" podUID="7f6128d3-c018-4e00-b2d9-f7b61acfede3"
Jul 16 13:41:37.071137 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.071107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:37.071298 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.071240    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 13:41:37.071341 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.071304    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert podName:32adff5f-4d40-4015-95bd-403c254c7b12 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:38.071288903 +0000 UTC m=+62.070320758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wt2fl" (UID: "32adff5f-4d40-4015-95bd-403c254c7b12") : secret "networking-console-plugin-cert" not found
Jul 16 13:41:37.365395 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.365326    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7hbbb"]
Jul 16 13:41:37.369502 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.369474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.372381 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.372355    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 13:41:37.372624 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.372606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzlst\""
Jul 16 13:41:37.372811 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.372795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 13:41:37.382823 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.382799    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7hbbb"]
Jul 16 13:41:37.474050 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.474017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.474199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.474068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-crio-socket\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.474199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.474155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.474199 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.474183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-data-volume\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.474310 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.474236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7bkd\" (UniqueName: \"kubernetes.io/projected/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-api-access-v7bkd\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.574664 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7bkd\" (UniqueName: \"kubernetes.io/projected/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-api-access-v7bkd\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.574826 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.574826 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-crio-socket\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.574826 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.574826 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-data-volume\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.575002 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.574872    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:37.575002 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.574852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-crio-socket\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.575002 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.574874    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 13:41:37.575002 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.574932    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:38.074917378 +0000 UTC m=+62.073949233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:37.575139 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.574999    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:38.07498217 +0000 UTC m=+62.074014038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : configmap "kube-rbac-proxy" not found
Jul 16 13:41:37.575139 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.575077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-data-volume\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.585900 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.585878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7bkd\" (UniqueName: \"kubernetes.io/projected/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-api-access-v7bkd\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:37.845256 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.845230    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:41:37.845741 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:37.845667    2558 scope.go:117] "RemoveContainer" containerID="4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1"
Jul 16 13:41:37.845900 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:37.845878    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s7kst_openshift-console-operator(7f6128d3-c018-4e00-b2d9-f7b61acfede3)\"" pod="openshift-console-operator/console-operator-7866497494-s7kst" podUID="7f6128d3-c018-4e00-b2d9-f7b61acfede3"
Jul 16 13:41:38.078890 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:38.078852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:38.079041 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:38.078901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:38.079041 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:38.078965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:38.079041 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079010    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 13:41:38.079041 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079032    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 13:41:38.079166 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079055    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:38.079166 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079119    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert podName:32adff5f-4d40-4015-95bd-403c254c7b12 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:40.079086728 +0000 UTC m=+64.078118590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wt2fl" (UID: "32adff5f-4d40-4015-95bd-403c254c7b12") : secret "networking-console-plugin-cert" not found
Jul 16 13:41:38.079166 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079143    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:39.07913401 +0000 UTC m=+63.078165865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:38.079166 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:38.079156    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:39.079149343 +0000 UTC m=+63.078181198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : configmap "kube-rbac-proxy" not found
Jul 16 13:41:39.088940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:39.088883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:39.089359 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:39.088972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:39.089359 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.089035    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:39.089359 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.089086    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 13:41:39.089359 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.089112    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:41.089097072 +0000 UTC m=+65.088128928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:39.089359 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.089135    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:41.089123144 +0000 UTC m=+65.088154999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : configmap "kube-rbac-proxy" not found
Jul 16 13:41:39.341744 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:39.341669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kmf9r_9bd44e71-7096-4513-9215-4432fb3bb979/dns-node-resolver/0.log"
Jul 16 13:41:39.995998 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:39.995963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:39.996179 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.996074    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 13:41:39.996179 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.996098    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c6d5cf898-qs9s2: secret "image-registry-tls" not found
Jul 16 13:41:39.996179 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:39.996153    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls podName:681e7bea-d4f0-41b5-be02-ce3971cd9e04 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:47.99613495 +0000 UTC m=+71.995166810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls") pod "image-registry-c6d5cf898-qs9s2" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04") : secret "image-registry-tls" not found
Jul 16 13:41:40.096830 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:40.096801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:40.097230 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:40.096978    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 13:41:40.097230 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:40.097064    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert podName:32adff5f-4d40-4015-95bd-403c254c7b12 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:44.097043762 +0000 UTC m=+68.096075632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wt2fl" (UID: "32adff5f-4d40-4015-95bd-403c254c7b12") : secret "networking-console-plugin-cert" not found
Jul 16 13:41:40.347546 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:40.347520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8m4ms_8d66373d-40f1-4521-aa76-1c34b8406d1c/node-ca/0.log"
Jul 16 13:41:41.105959 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.105899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:41.106442 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.106003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:41.106442 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.106069    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:41.106442 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.106117    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 13:41:41.106442 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.106146    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:45.106128382 +0000 UTC m=+69.105160237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:41.106442 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.106166    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:45.10615415 +0000 UTC m=+69.105186005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : configmap "kube-rbac-proxy" not found
Jul 16 13:41:41.142559 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.142537    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkrf5_a799d138-cd10-44b0-bdc7-94d8be95575c/serve-healthcheck-canary/0.log"
Jul 16 13:41:41.207062 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.207037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:41.207062 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.207064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:41:41.209668 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.209644    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 13:41:41.209799 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.209784    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 13:41:41.217861 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.217845    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 13:41:41.217930 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:41.217901    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs podName:47dc235e-43e7-48c9-8d3d-473816e01efc nodeName:}" failed. No retries permitted until 2026-07-16 13:42:45.217884654 +0000 UTC m=+129.216916513 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs") pod "network-metrics-daemon-726ml" (UID: "47dc235e-43e7-48c9-8d3d-473816e01efc") : secret "metrics-daemon-secret" not found
Jul 16 13:41:41.220061 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.220041    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/66c55ac9-cb12-429a-b72c-7ac948ed30a6-original-pull-secret\") pod \"global-pull-secret-syncer-n4vfc\" (UID: \"66c55ac9-cb12-429a-b72c-7ac948ed30a6\") " pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:41.307946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.307928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:41.310681 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.310666    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 13:41:41.321363 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.321346    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 13:41:41.332102 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.332078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhcp\" (UniqueName: \"kubernetes.io/projected/99eded7b-b614-4ec7-a05b-ddb14d0c9d2a-kube-api-access-kzhcp\") pod \"network-check-target-46lgl\" (UID: \"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a\") " pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:41.426448 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.426391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6lhsq\""
Jul 16 13:41:41.428266 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.428252    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4vfc"
Jul 16 13:41:41.434458 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.434443    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:41.558096 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.558073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46lgl"]
Jul 16 13:41:41.559905 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:41.559879    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eded7b_b614_4ec7_a05b_ddb14d0c9d2a.slice/crio-82962e6d2d47ad9745660794503d0b3a1eafd86fa7a65ce55b939feaee59f96f WatchSource:0}: Error finding container 82962e6d2d47ad9745660794503d0b3a1eafd86fa7a65ce55b939feaee59f96f: Status 404 returned error can't find the container with id 82962e6d2d47ad9745660794503d0b3a1eafd86fa7a65ce55b939feaee59f96f
Jul 16 13:41:41.575039 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.575017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4vfc"]
Jul 16 13:41:41.578554 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:41.578531    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c55ac9_cb12_429a_b72c_7ac948ed30a6.slice/crio-343ede1791ad35f30750beb985ddfeee5d0cc77a6d8d5a745693764342318cb0 WatchSource:0}: Error finding container 343ede1791ad35f30750beb985ddfeee5d0cc77a6d8d5a745693764342318cb0: Status 404 returned error can't find the container with id 343ede1791ad35f30750beb985ddfeee5d0cc77a6d8d5a745693764342318cb0
Jul 16 13:41:41.856240 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.856204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4vfc" event={"ID":"66c55ac9-cb12-429a-b72c-7ac948ed30a6","Type":"ContainerStarted","Data":"343ede1791ad35f30750beb985ddfeee5d0cc77a6d8d5a745693764342318cb0"}
Jul 16 13:41:41.857245 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:41.857226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46lgl" event={"ID":"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a","Type":"ContainerStarted","Data":"82962e6d2d47ad9745660794503d0b3a1eafd86fa7a65ce55b939feaee59f96f"}
Jul 16 13:41:42.216737 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:42.216646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:41:42.217112 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:42.216764    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 13:41:42.217112 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:42.216819    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls podName:4c05b0c3-48f6-4e83-9075-91b624b6b6bb nodeName:}" failed. No retries permitted until 2026-07-16 13:42:14.216804153 +0000 UTC m=+98.215836008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls") pod "dns-default-xr8t4" (UID: "4c05b0c3-48f6-4e83-9075-91b624b6b6bb") : secret "dns-default-metrics-tls" not found
Jul 16 13:41:42.690375 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:42.690330    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:42.690587 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:42.690395    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:42.690859 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:42.690836    2558 scope.go:117] "RemoveContainer" containerID="4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1"
Jul 16 13:41:42.691051 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:42.691031    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-s7kst_openshift-console-operator(7f6128d3-c018-4e00-b2d9-f7b61acfede3)\"" pod="openshift-console-operator/console-operator-7866497494-s7kst" podUID="7f6128d3-c018-4e00-b2d9-f7b61acfede3"
Jul 16 13:41:44.135602 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:44.135562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:44.136061 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:44.135746    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 16 13:41:44.136061 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:44.135842    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert podName:32adff5f-4d40-4015-95bd-403c254c7b12 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:52.135820185 +0000 UTC m=+76.134852050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wt2fl" (UID: "32adff5f-4d40-4015-95bd-403c254c7b12") : secret "networking-console-plugin-cert" not found
Jul 16 13:41:44.868076 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:44.868041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46lgl" event={"ID":"99eded7b-b614-4ec7-a05b-ddb14d0c9d2a","Type":"ContainerStarted","Data":"52fcddf710598cdfd7f2dc48cbb64bbea8b710d9243478c917e7feccc643cf85"}
Jul 16 13:41:44.868245 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:44.868183    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:41:44.884989 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:44.884944    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-46lgl" podStartSLOduration=65.897198889 podStartE2EDuration="1m8.884929004s" totalImagesPullingTime="2.987730115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:44.884129909 +0000 UTC m=+68.883161786" watchObservedRunningTime="2026-07-16 13:41:44.884929004 +0000 UTC m=+68.883960882"
Jul 16 13:41:45.144748 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:45.144658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:45.145193 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:45.144772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:45.145193 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:45.144849    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:45.145193 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:45.144904    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 13:41:45.145193 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:45.144933    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:53.144914543 +0000 UTC m=+77.143946423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : secret "insights-runtime-extractor-tls" not found
Jul 16 13:41:45.145193 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:41:45.144963    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm podName:fe90d63f-2ac3-4bb9-9595-a2eaefe60b99 nodeName:}" failed. No retries permitted until 2026-07-16 13:41:53.144945224 +0000 UTC m=+77.143977092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7hbbb" (UID: "fe90d63f-2ac3-4bb9-9595-a2eaefe60b99") : configmap "kube-rbac-proxy" not found
Jul 16 13:41:46.877916 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:46.877872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4vfc" event={"ID":"66c55ac9-cb12-429a-b72c-7ac948ed30a6","Type":"ContainerStarted","Data":"35386f7a7ca845afa46c41100716b76b403c24a4600604049df428c8ca98de92"}
Jul 16 13:41:46.895054 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:46.895006    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4vfc" podStartSLOduration=66.46548591 podStartE2EDuration="1m10.894991841s" totalImagesPullingTime="4.429505931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:46.894440271 +0000 UTC m=+70.893472166" watchObservedRunningTime="2026-07-16 13:41:46.894991841 +0000 UTC m=+70.894023725"
Jul 16 13:41:48.067991 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.067957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:48.070246 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.070226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"image-registry-c6d5cf898-qs9s2\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") " pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:48.366420 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.366344    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xfh2z\""
Jul 16 13:41:48.374688 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.374671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:48.497453 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.497430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:41:48.499666 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:48.499636    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681e7bea_d4f0_41b5_be02_ce3971cd9e04.slice/crio-6d738afce9a4631eb8c4542534d5b9a7d77b5526a71c3cd885ebe6dc4f3d4c8f WatchSource:0}: Error finding container 6d738afce9a4631eb8c4542534d5b9a7d77b5526a71c3cd885ebe6dc4f3d4c8f: Status 404 returned error can't find the container with id 6d738afce9a4631eb8c4542534d5b9a7d77b5526a71c3cd885ebe6dc4f3d4c8f
Jul 16 13:41:48.885656 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.885622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" event={"ID":"681e7bea-d4f0-41b5-be02-ce3971cd9e04","Type":"ContainerStarted","Data":"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"}
Jul 16 13:41:48.885823 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.885669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" event={"ID":"681e7bea-d4f0-41b5-be02-ce3971cd9e04","Type":"ContainerStarted","Data":"6d738afce9a4631eb8c4542534d5b9a7d77b5526a71c3cd885ebe6dc4f3d4c8f"}
Jul 16 13:41:48.885823 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.885748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:41:48.906974 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:48.906927    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" podStartSLOduration=16.906913717 podStartE2EDuration="16.906913717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:48.906182883 +0000 UTC m=+72.905214761" watchObservedRunningTime="2026-07-16 13:41:48.906913717 +0000 UTC m=+72.905945594"
Jul 16 13:41:52.196902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:52.196854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:52.199186 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:52.199163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32adff5f-4d40-4015-95bd-403c254c7b12-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wt2fl\" (UID: \"32adff5f-4d40-4015-95bd-403c254c7b12\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:52.271356 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:52.271325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"
Jul 16 13:41:52.391534 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:52.391502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wt2fl"]
Jul 16 13:41:52.394998 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:52.394967    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32adff5f_4d40_4015_95bd_403c254c7b12.slice/crio-4232f8f88e4fc9c99fdfc73eee60ab9d5cb5c1870226c01b91acae4f83c70d61 WatchSource:0}: Error finding container 4232f8f88e4fc9c99fdfc73eee60ab9d5cb5c1870226c01b91acae4f83c70d61: Status 404 returned error can't find the container with id 4232f8f88e4fc9c99fdfc73eee60ab9d5cb5c1870226c01b91acae4f83c70d61
Jul 16 13:41:52.900171 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:52.900131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl" event={"ID":"32adff5f-4d40-4015-95bd-403c254c7b12","Type":"ContainerStarted","Data":"4232f8f88e4fc9c99fdfc73eee60ab9d5cb5c1870226c01b91acae4f83c70d61"}
Jul 16 13:41:53.202837 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.202738    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:53.202837 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.202825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:53.203419 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.203395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:53.205916 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.205895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fe90d63f-2ac3-4bb9-9595-a2eaefe60b99-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7hbbb\" (UID: \"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99\") " pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:53.281209 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.281177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7hbbb"
Jul 16 13:41:53.626708 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.626661    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7hbbb"]
Jul 16 13:41:53.629099 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:41:53.629078    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe90d63f_2ac3_4bb9_9595_a2eaefe60b99.slice/crio-32960e816f1a578c758b51cad98bd4d6d6ee0b7d9dcdf90ddfcf1bc3b76eeb3d WatchSource:0}: Error finding container 32960e816f1a578c758b51cad98bd4d6d6ee0b7d9dcdf90ddfcf1bc3b76eeb3d: Status 404 returned error can't find the container with id 32960e816f1a578c758b51cad98bd4d6d6ee0b7d9dcdf90ddfcf1bc3b76eeb3d
Jul 16 13:41:53.904303 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.904269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hbbb" event={"ID":"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99","Type":"ContainerStarted","Data":"32960e816f1a578c758b51cad98bd4d6d6ee0b7d9dcdf90ddfcf1bc3b76eeb3d"}
Jul 16 13:41:53.905597 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.905579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl" event={"ID":"32adff5f-4d40-4015-95bd-403c254c7b12","Type":"ContainerStarted","Data":"d45d96f3550cfec239f1feb1569bbbd140a15ed338af0d4ee0af130102e21261"}
Jul 16 13:41:53.922640 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:53.922595    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-wt2fl" podStartSLOduration=16.762108973 podStartE2EDuration="17.922579559s" totalImagesPullingTime="1.160470586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:53.921653374 +0000 UTC m=+77.920685250" watchObservedRunningTime="2026-07-16 13:41:53.922579559 +0000 UTC m=+77.921611435"
Jul 16 13:41:54.509933 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:54.509553    2558 scope.go:117] "RemoveContainer" containerID="4e3c3197423f734d213beee381f5d16b6431a1df0045788ed160464e67f273b1"
Jul 16 13:41:54.910886 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:54.910849    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:41:54.911075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:54.910989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-s7kst" event={"ID":"7f6128d3-c018-4e00-b2d9-f7b61acfede3","Type":"ContainerStarted","Data":"d726b7922a4ac81e8f1a97d362fb4c14ee5a89b9bb022db7c418f156f27c6824"}
Jul 16 13:41:54.911508 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:54.911471    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:54.929550 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:54.929468    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-s7kst" podStartSLOduration=20.239878875 podStartE2EDuration="22.929442603s" totalImagesPullingTime="2.689563728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:41:54.928412385 +0000 UTC m=+78.927444263" watchObservedRunningTime="2026-07-16 13:41:54.929442603 +0000 UTC m=+78.928474486"
Jul 16 13:41:55.643397 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:55.643367    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-s7kst"
Jul 16 13:41:58.926532 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:41:58.926500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hbbb" event={"ID":"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99","Type":"ContainerStarted","Data":"27f84fecf90112326d9c194b38aa5e34c041a0c68dddf52bd2ffa54aa9274246"}
Jul 16 13:42:00.661618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.661572    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"]
Jul 16 13:42:00.668033 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.668011    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"]
Jul 16 13:42:00.668181 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.668154    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.672051 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672023    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 13:42:00.672051 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672045    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 13:42:00.672232 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672137    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 13:42:00.672921 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 13:42:00.673052 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672921    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 13:42:00.673052 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.672947    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 13:42:00.673052 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.673022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 13:42:00.673624 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.673607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.676279 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.676258    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 13:42:00.679034 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.678735    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"]
Jul 16 13:42:00.680144 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.680124    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"]
Jul 16 13:42:00.714359 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.714314    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:42:00.760585 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/026d7298-d1e3-458f-898c-7afa8bfa3943-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.760744 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.760744 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.760837 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.760837 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.760926 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/026d7298-d1e3-458f-898c-7afa8bfa3943-tmp\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.760977 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsnfh\" (UniqueName: \"kubernetes.io/projected/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-kube-api-access-wsnfh\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.760977 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.761053 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.760986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvhfj\" (UniqueName: \"kubernetes.io/projected/026d7298-d1e3-458f-898c-7afa8bfa3943-kube-api-access-lvhfj\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.861881 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.861849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862057 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.861892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvhfj\" (UniqueName: \"kubernetes.io/projected/026d7298-d1e3-458f-898c-7afa8bfa3943-kube-api-access-lvhfj\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.862057 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.861919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/026d7298-d1e3-458f-898c-7afa8bfa3943-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.862180 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862180 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862281 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862281 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862281 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/026d7298-d1e3-458f-898c-7afa8bfa3943-tmp\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.862427 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsnfh\" (UniqueName: \"kubernetes.io/projected/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-kube-api-access-wsnfh\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862753 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.862874 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.862857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/026d7298-d1e3-458f-898c-7afa8bfa3943-tmp\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.865072 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.865042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-ca\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.865180 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.865104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.865180 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.865135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/026d7298-d1e3-458f-898c-7afa8bfa3943-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.865455 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.865426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.865455 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.865444    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-hub\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.871808 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.871789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvhfj\" (UniqueName: \"kubernetes.io/projected/026d7298-d1e3-458f-898c-7afa8bfa3943-kube-api-access-lvhfj\") pod \"klusterlet-addon-workmgr-67c477bc8d-bpj27\" (UID: \"026d7298-d1e3-458f-898c-7afa8bfa3943\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:00.872555 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.872465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsnfh\" (UniqueName: \"kubernetes.io/projected/40d335d8-e7a5-4287-ae6d-fc0a7bd40196-kube-api-access-wsnfh\") pod \"cluster-proxy-proxy-agent-b6b47fb57-mw8x4\" (UID: \"40d335d8-e7a5-4287-ae6d-fc0a7bd40196\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:00.999150 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:00.999071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"
Jul 16 13:42:01.006975 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:01.006952    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:02.549150 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:02.549117    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"]
Jul 16 13:42:02.551700 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:02.551672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod026d7298_d1e3_458f_898c_7afa8bfa3943.slice/crio-e4ba05d06dd2b29222e3110b1993bc7d80bd1a4c458dc30c0049a920451f2c9d WatchSource:0}: Error finding container e4ba05d06dd2b29222e3110b1993bc7d80bd1a4c458dc30c0049a920451f2c9d: Status 404 returned error can't find the container with id e4ba05d06dd2b29222e3110b1993bc7d80bd1a4c458dc30c0049a920451f2c9d
Jul 16 13:42:02.568219 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:02.568196    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4"]
Jul 16 13:42:02.570863 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:02.570838    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40d335d8_e7a5_4287_ae6d_fc0a7bd40196.slice/crio-5e31e9950f1fb83473028bd4c6aa910729842f7357cc75277ba5ddd8e52adda0 WatchSource:0}: Error finding container 5e31e9950f1fb83473028bd4c6aa910729842f7357cc75277ba5ddd8e52adda0: Status 404 returned error can't find the container with id 5e31e9950f1fb83473028bd4c6aa910729842f7357cc75277ba5ddd8e52adda0
Jul 16 13:42:02.941290 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:02.941252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27" event={"ID":"026d7298-d1e3-458f-898c-7afa8bfa3943","Type":"ContainerStarted","Data":"e4ba05d06dd2b29222e3110b1993bc7d80bd1a4c458dc30c0049a920451f2c9d"}
Jul 16 13:42:02.942376 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:02.942345    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4" event={"ID":"40d335d8-e7a5-4287-ae6d-fc0a7bd40196","Type":"ContainerStarted","Data":"5e31e9950f1fb83473028bd4c6aa910729842f7357cc75277ba5ddd8e52adda0"}
Jul 16 13:42:02.944087 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:02.944063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hbbb" event={"ID":"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99","Type":"ContainerStarted","Data":"61ff9b860adc8adf5135f240a8d3096a0f14f5fd8c900a917f51d8e70b924c03"}
Jul 16 13:42:09.981341 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.981301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7hbbb" event={"ID":"fe90d63f-2ac3-4bb9-9595-a2eaefe60b99","Type":"ContainerStarted","Data":"225afe217ad2c63ecacac6c07b3ce33f6b1e11c5f53d2a4b4060353f95880f78"}
Jul 16 13:42:09.983126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.983084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27" event={"ID":"026d7298-d1e3-458f-898c-7afa8bfa3943","Type":"ContainerStarted","Data":"d10a39da85954ee7f3fc01dc42f0c622bdc3d7b0abc6afcead34938c92ac3c77"}
Jul 16 13:42:09.986721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.983467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:09.987352 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.987331    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27"
Jul 16 13:42:09.988963 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.988941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4" event={"ID":"40d335d8-e7a5-4287-ae6d-fc0a7bd40196","Type":"ContainerStarted","Data":"a2d0f9633d9626ad7af68ce01df21f5613d0744030bc2c6c273f35368bb2834a"}
Jul 16 13:42:09.989082 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.988974    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4" event={"ID":"40d335d8-e7a5-4287-ae6d-fc0a7bd40196","Type":"ContainerStarted","Data":"450436cf2aa6dbb3911af861c40c9d4464ef035569e126bd134973b371334354"}
Jul 16 13:42:09.989082 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:09.988988    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4" event={"ID":"40d335d8-e7a5-4287-ae6d-fc0a7bd40196","Type":"ContainerStarted","Data":"3c03b4ca7f674572a592fa51249a38e3477e614db707950ea6a29d7a746e0cf7"}
Jul 16 13:42:10.003198 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:10.003158    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7hbbb" podStartSLOduration=17.225953132 podStartE2EDuration="33.003146362s" totalImagesPullingTime="15.77719323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 13:41:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:10.001951924 +0000 UTC m=+94.000983817" watchObservedRunningTime="2026-07-16 13:42:10.003146362 +0000 UTC m=+94.002178238"
Jul 16 13:42:10.019089 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:10.019053    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b6b47fb57-mw8x4" podStartSLOduration=3.051503116 podStartE2EDuration="10.019040479s" totalImagesPullingTime="6.967537363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:10.018850732 +0000 UTC m=+94.017882609" watchObservedRunningTime="2026-07-16 13:42:10.019040479 +0000 UTC m=+94.018072358"
Jul 16 13:42:10.034226 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:10.034183    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c477bc8d-bpj27" podStartSLOduration=3.046898167 podStartE2EDuration="10.034170155s" totalImagesPullingTime="6.987271988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:10.033721641 +0000 UTC m=+94.032753517" watchObservedRunningTime="2026-07-16 13:42:10.034170155 +0000 UTC m=+94.033202032"
Jul 16 13:42:10.719443 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:10.719412    2558 patch_prober.go:28] interesting pod/image-registry-c6d5cf898-qs9s2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 13:42:10.719603 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:10.719466    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 13:42:14.279811 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:14.279776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:42:14.282138 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:14.282113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c05b0c3-48f6-4e83-9075-91b624b6b6bb-metrics-tls\") pod \"dns-default-xr8t4\" (UID: \"4c05b0c3-48f6-4e83-9075-91b624b6b6bb\") " pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:42:14.573934 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:14.573909    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xfg5g\""
Jul 16 13:42:14.582211 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:14.582194    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:42:14.709735 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:14.709672    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xr8t4"]
Jul 16 13:42:14.712084 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:14.712057    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c05b0c3_48f6_4e83_9075_91b624b6b6bb.slice/crio-d45494192ea10d48e9ef537a73fa228841546a8361e75859be0092770d6cc2ca WatchSource:0}: Error finding container d45494192ea10d48e9ef537a73fa228841546a8361e75859be0092770d6cc2ca: Status 404 returned error can't find the container with id d45494192ea10d48e9ef537a73fa228841546a8361e75859be0092770d6cc2ca
Jul 16 13:42:15.009160 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:15.009081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr8t4" event={"ID":"4c05b0c3-48f6-4e83-9075-91b624b6b6bb","Type":"ContainerStarted","Data":"d45494192ea10d48e9ef537a73fa228841546a8361e75859be0092770d6cc2ca"}
Jul 16 13:42:15.873251 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:15.873220    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-46lgl"
Jul 16 13:42:18.020612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:18.020515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr8t4" event={"ID":"4c05b0c3-48f6-4e83-9075-91b624b6b6bb","Type":"ContainerStarted","Data":"8faef004b2edec2bd6d340eb7ce06edc0fa8f0cbe39afe7a4147f3d24afbb7dc"}
Jul 16 13:42:18.020612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:18.020568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xr8t4" event={"ID":"4c05b0c3-48f6-4e83-9075-91b624b6b6bb","Type":"ContainerStarted","Data":"aa72c32ca0641bce1042215c72be4ee7277001ffa863cdeb61d304e368f73ff9"}
Jul 16 13:42:18.020612 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:18.020604    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:42:18.038860 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:18.038813    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xr8t4" podStartSLOduration=65.449564027 podStartE2EDuration="1m8.038799545s" totalImagesPullingTime="2.589235518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:18.038469675 +0000 UTC m=+102.037501571" watchObservedRunningTime="2026-07-16 13:42:18.038799545 +0000 UTC m=+102.037831471"
Jul 16 13:42:20.719528 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:20.719484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:42:25.237822 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.237792    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8j9f"]
Jul 16 13:42:25.245089 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.245068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.247686 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.247659    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 13:42:25.247817 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.247744    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 13:42:25.247817 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.247775    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 13:42:25.248026 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.248011    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 13:42:25.248143 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.248081    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-89v2l\""
Jul 16 13:42:25.249027 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.249014    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 13:42:25.249092 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.249024    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 13:42:25.374893 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.374850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.374896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-textfile\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.374978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvggs\" (UniqueName: \"kubernetes.io/projected/1d1a6db7-1749-4d69-8e4e-e8fde254e528-kube-api-access-tvggs\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375075 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-sys\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375206 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-metrics-client-ca\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375206 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375206 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-wtmp\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.375206 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.375192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-root\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476194 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476194 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvggs\" (UniqueName: \"kubernetes.io/projected/1d1a6db7-1749-4d69-8e4e-e8fde254e528-kube-api-access-tvggs\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-sys\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-metrics-client-ca\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:42:25.476317    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-sys\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-wtmp\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476413 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:42:25.476398    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls podName:1d1a6db7-1749-4d69-8e4e-e8fde254e528 nodeName:}" failed. No retries permitted until 2026-07-16 13:42:25.976377885 +0000 UTC m=+109.975409742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls") pod "node-exporter-s8j9f" (UID: "1d1a6db7-1749-4d69-8e4e-e8fde254e528") : secret "node-exporter-tls" not found
Jul 16 13:42:25.476776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-wtmp\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476512    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-root\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d1a6db7-1749-4d69-8e4e-e8fde254e528-root\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476590    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.476776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-textfile\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.477009 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-textfile\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.477009 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.476995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.477100 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.477034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d1a6db7-1749-4d69-8e4e-e8fde254e528-metrics-client-ca\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.479004 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.478983    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.485333 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.485307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvggs\" (UniqueName: \"kubernetes.io/projected/1d1a6db7-1749-4d69-8e4e-e8fde254e528-kube-api-access-tvggs\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.736876 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.736829    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerName="registry" containerID="cri-o://ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295" gracePeriod=30
Jul 16 13:42:25.974762 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.974733    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:42:25.981682 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.981657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:25.983788 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:25.983770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d1a6db7-1749-4d69-8e4e-e8fde254e528-node-exporter-tls\") pod \"node-exporter-s8j9f\" (UID: \"1d1a6db7-1749-4d69-8e4e-e8fde254e528\") " pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:26.044800 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.044738    2558 generic.go:356] "Generic (PLEG): container finished" podID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerID="ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295" exitCode=0
Jul 16 13:42:26.044800 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.044780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" event={"ID":"681e7bea-d4f0-41b5-be02-ce3971cd9e04","Type":"ContainerDied","Data":"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"}
Jul 16 13:42:26.044942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.044815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2" event={"ID":"681e7bea-d4f0-41b5-be02-ce3971cd9e04","Type":"ContainerDied","Data":"6d738afce9a4631eb8c4542534d5b9a7d77b5526a71c3cd885ebe6dc4f3d4c8f"}
Jul 16 13:42:26.044942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.044834    2558 scope.go:117] "RemoveContainer" containerID="ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"
Jul 16 13:42:26.044942 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.044781    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6d5cf898-qs9s2"
Jul 16 13:42:26.054460 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.052542    2558 scope.go:117] "RemoveContainer" containerID="ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"
Jul 16 13:42:26.055138 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:42:26.055116    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295\": container with ID starting with ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295 not found: ID does not exist" containerID="ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"
Jul 16 13:42:26.055207 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.055146    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295"} err="failed to get container status \"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295\": rpc error: code = NotFound desc = could not find container \"ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295\": container with ID starting with ca9f86a1f0f5bc1a8d5ee8eca8dc017cd52036718b554f24504f347ed9fab295 not found: ID does not exist"
Jul 16 13:42:26.082470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082446    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082582 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082506    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrpg9\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082582 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082533    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082602    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082637    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082680    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082707    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.082916 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.082730    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates\") pod \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\" (UID: \"681e7bea-d4f0-41b5-be02-ce3971cd9e04\") "
Jul 16 13:42:26.083157 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.083098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:42:26.083417 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.083379    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 13:42:26.084962 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.084920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:42:26.085167 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.085126    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9" (OuterVolumeSpecName: "kube-api-access-hrpg9") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "kube-api-access-hrpg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:42:26.085167 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.085135    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:42:26.085282 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.085190    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:42:26.085320 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.085286    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:42:26.090642 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.090622    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "681e7bea-d4f0-41b5-be02-ce3971cd9e04" (UID: "681e7bea-d4f0-41b5-be02-ce3971cd9e04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 13:42:26.154731 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.154709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8j9f"
Jul 16 13:42:26.167516 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:26.167468    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1a6db7_1749_4d69_8e4e_e8fde254e528.slice/crio-c160e107d3697db0cf6d88c53a48fb9a2d88a1d9a7c31219225b62db764ad157 WatchSource:0}: Error finding container c160e107d3697db0cf6d88c53a48fb9a2d88a1d9a7c31219225b62db764ad157: Status 404 returned error can't find the container with id c160e107d3697db0cf6d88c53a48fb9a2d88a1d9a7c31219225b62db764ad157
Jul 16 13:42:26.183358 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183340    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-bound-sa-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183358 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183359    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-trusted-ca\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183369    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-image-registry-private-configuration\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183379    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/681e7bea-d4f0-41b5-be02-ce3971cd9e04-ca-trust-extracted\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183388    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-certificates\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183398    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/681e7bea-d4f0-41b5-be02-ce3971cd9e04-installation-pull-secrets\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183405    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpg9\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-kube-api-access-hrpg9\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.183467 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.183413    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/681e7bea-d4f0-41b5-be02-ce3971cd9e04-registry-tls\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:42:26.368403 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.368371    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:42:26.370307 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.370283    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c6d5cf898-qs9s2"]
Jul 16 13:42:26.507619 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:26.507590    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" path="/var/lib/kubelet/pods/681e7bea-d4f0-41b5-be02-ce3971cd9e04/volumes"
Jul 16 13:42:27.049151 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:27.049119    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8j9f" event={"ID":"1d1a6db7-1749-4d69-8e4e-e8fde254e528","Type":"ContainerStarted","Data":"c160e107d3697db0cf6d88c53a48fb9a2d88a1d9a7c31219225b62db764ad157"}
Jul 16 13:42:28.026142 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:28.026111    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xr8t4"
Jul 16 13:42:28.056940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:28.056910    2558 generic.go:356] "Generic (PLEG): container finished" podID="1d1a6db7-1749-4d69-8e4e-e8fde254e528" containerID="47f5f5ba6f3603c266249461778ed0e13b2a3ebc26a3c31de8957a8e96fe6984" exitCode=0
Jul 16 13:42:28.057114 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:28.056997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8j9f" event={"ID":"1d1a6db7-1749-4d69-8e4e-e8fde254e528","Type":"ContainerDied","Data":"47f5f5ba6f3603c266249461778ed0e13b2a3ebc26a3c31de8957a8e96fe6984"}
Jul 16 13:42:29.062253 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:29.062220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8j9f" event={"ID":"1d1a6db7-1749-4d69-8e4e-e8fde254e528","Type":"ContainerStarted","Data":"836c851de6777aa561a97f5c03cd20f96bb7b4809f5e458d10dba815350c0dcb"}
Jul 16 13:42:29.062652 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:29.062270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8j9f" event={"ID":"1d1a6db7-1749-4d69-8e4e-e8fde254e528","Type":"ContainerStarted","Data":"641dfc0633eddfb44abd76e2b55745944c2e0b60ba92fa59ebe877c707142fac"}
Jul 16 13:42:29.087575 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:29.087529    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8j9f" podStartSLOduration=3.119946465 podStartE2EDuration="4.087512907s" totalImagesPullingTime="904.535073ms" totalInitContainerRuntime="63.031369ms" isStatefulPod=true podCreationTimestamp="2026-07-16 13:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:29.086162197 +0000 UTC m=+113.085194073" watchObservedRunningTime="2026-07-16 13:42:29.087512907 +0000 UTC m=+113.086544784"
Jul 16 13:42:30.462434 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.462399    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"]
Jul 16 13:42:30.462828 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.462681    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerName="registry"
Jul 16 13:42:30.462828 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.462693    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerName="registry"
Jul 16 13:42:30.462828 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.462750    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="681e7bea-d4f0-41b5-be02-ce3971cd9e04" containerName="registry"
Jul 16 13:42:30.467125 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.467105    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.470550 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.470463    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 16 13:42:30.470664 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.470645    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 16 13:42:30.470883 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.470862    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 16 13:42:30.470994 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.470866    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 16 13:42:30.471156 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.471141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f52zv\""
Jul 16 13:42:30.474597 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.474579    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 16 13:42:30.477245 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.477229    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 16 13:42:30.488072 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.488052    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"]
Jul 16 13:42:30.619126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619343 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619343 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-metrics-client-ca\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619343 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhtg\" (UniqueName: \"kubernetes.io/projected/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-kube-api-access-ddhtg\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619343 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-federate-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619343 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-serving-certs-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.619590 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.619383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720154 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720154 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720154 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-metrics-client-ca\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhtg\" (UniqueName: \"kubernetes.io/projected/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-kube-api-access-ddhtg\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-federate-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.720439 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.720437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-serving-certs-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.721152 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.721121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-metrics-client-ca\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.721279 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.721151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-serving-certs-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.721348 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.721269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.723043 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.723015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.723177 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.723091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-telemeter-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.723177 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.723146    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.723283 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.723185    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-federate-client-tls\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.729540 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.729483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhtg\" (UniqueName: \"kubernetes.io/projected/b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f-kube-api-access-ddhtg\") pod \"telemeter-client-5cf7fb8896-6q5vk\" (UID: \"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f\") " pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.776447 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.776414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"
Jul 16 13:42:30.912346 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:30.912322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk"]
Jul 16 13:42:30.914607 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:30.914579    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57f818c_9a9e_4bc9_bdf6_2bd3bf236c4f.slice/crio-695a4b3441cd8a4b739817197e974f08253aba7a6d7de0720c7e6508c2fc5444 WatchSource:0}: Error finding container 695a4b3441cd8a4b739817197e974f08253aba7a6d7de0720c7e6508c2fc5444: Status 404 returned error can't find the container with id 695a4b3441cd8a4b739817197e974f08253aba7a6d7de0720c7e6508c2fc5444
Jul 16 13:42:31.070677 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.070644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk" event={"ID":"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f","Type":"ContainerStarted","Data":"695a4b3441cd8a4b739817197e974f08253aba7a6d7de0720c7e6508c2fc5444"}
Jul 16 13:42:31.513644 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.513573    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 13:42:31.577098 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.577065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 13:42:31.577238 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.577212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.580208 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.580187    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 13:42:31.582671 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.582651    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 13:42:31.582841 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.582679    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 13:42:31.583069 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.583030    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lkvhx\""
Jul 16 13:42:31.583292 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.583269    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 13:42:31.583733 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.583714    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bhban3j6davqq\""
Jul 16 13:42:31.584524 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.584275    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 13:42:31.584524 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.584302    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 13:42:31.584659 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.584594    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 13:42:31.584737 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.584701    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 13:42:31.585061 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.585043    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 13:42:31.585305 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.585288    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 13:42:31.585392 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.585359    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 13:42:31.585392 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.585365    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 13:42:31.587429 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.587412    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 13:42:31.588721 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.588703    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 13:42:31.592190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.592174    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 13:42:31.728704 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g675c\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-kube-api-access-g675c\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.728902 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.728988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729044    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729196 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.729470 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.729318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830104 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830104 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g675c\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-kube-api-access-g675c\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.830836 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.830819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.831329 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.831256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.831387 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.831334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.832257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.832224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.833388 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.832857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.833388 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.833113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.833388 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.833271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.834177 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.834002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.835970 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.835943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.836063 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.836013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.836132 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.836080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.836442 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.836415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.836632 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.836557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.836948 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.836903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/618858fe-ec8a-439b-a23d-079db87a4d1a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.837094 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.837045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-web-config\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.837306 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.837278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/618858fe-ec8a-439b-a23d-079db87a4d1a-config-out\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.837632 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.837600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.838076 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.838052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.838901 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.838872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/618858fe-ec8a-439b-a23d-079db87a4d1a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.840749 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.840713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g675c\" (UniqueName: \"kubernetes.io/projected/618858fe-ec8a-439b-a23d-079db87a4d1a-kube-api-access-g675c\") pod \"prometheus-k8s-0\" (UID: \"618858fe-ec8a-439b-a23d-079db87a4d1a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:31.887658 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:31.887624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:32.081606 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:32.081569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 13:42:32.083736 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:32.083705    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618858fe_ec8a_439b_a23d_079db87a4d1a.slice/crio-254228629ce01cb64ecc14c7fe7f94c5be8d7026f6439ae1ea3c05ec9c932e68 WatchSource:0}: Error finding container 254228629ce01cb64ecc14c7fe7f94c5be8d7026f6439ae1ea3c05ec9c932e68: Status 404 returned error can't find the container with id 254228629ce01cb64ecc14c7fe7f94c5be8d7026f6439ae1ea3c05ec9c932e68
Jul 16 13:42:33.080538 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:33.080509    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"254228629ce01cb64ecc14c7fe7f94c5be8d7026f6439ae1ea3c05ec9c932e68"}
Jul 16 13:42:34.086197 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.086166    2558 generic.go:356] "Generic (PLEG): container finished" podID="618858fe-ec8a-439b-a23d-079db87a4d1a" containerID="4cd288985111d34a5e72b4f33e6643ff64b1515515722e18e927c6daf86a0592" exitCode=0
Jul 16 13:42:34.086618 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.086250    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerDied","Data":"4cd288985111d34a5e72b4f33e6643ff64b1515515722e18e927c6daf86a0592"}
Jul 16 13:42:34.088794 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.088769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk" event={"ID":"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f","Type":"ContainerStarted","Data":"944174839d01b0920aabd9f93f052779766688f75e198a3083fa75eb4937a4cf"}
Jul 16 13:42:34.088911 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.088825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk" event={"ID":"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f","Type":"ContainerStarted","Data":"b207f04fda2dbabdf207d040e72ef1bef5535c741da7b6401dc70ace5f5da3f5"}
Jul 16 13:42:34.088911 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.088855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk" event={"ID":"b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f","Type":"ContainerStarted","Data":"86f84c5d012633ebe41fc1bfbdadd1bcb1c04028a7d5dab6615aaf4f1df55e64"}
Jul 16 13:42:34.142074 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:34.142022    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cf7fb8896-6q5vk" podStartSLOduration=1.251559769 podStartE2EDuration="4.142006931s" totalImagesPullingTime="2.890447162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:34.135729799 +0000 UTC m=+118.134761687" watchObservedRunningTime="2026-07-16 13:42:34.142006931 +0000 UTC m=+118.141038808"
Jul 16 13:42:39.110212 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:39.110179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"894731c2364c7ab6a7e0ceb8a920581ac1328dc87925c75dfc9eb1e3115c8374"}
Jul 16 13:42:39.110651 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:39.110258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"a59ccfa82b1c4d9be54847a3eef39a9ef112049b06e30027ba65861d876c2981"}
Jul 16 13:42:41.124396 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.124296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"9db76207166229263c46c7bf55877f70dbabe1d0e23da8c6524614c98102176a"}
Jul 16 13:42:41.124396 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.124392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"6db0ef1f82aec89ca55016b9132a499f77fc3b52e3017a5d9deaa7444463c9f8"}
Jul 16 13:42:41.124852 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.124419    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"397d2b72f3440a51e4d604bc4f5081a88f3cb1be56873bdd88fec273ee6f77f8"}
Jul 16 13:42:41.124852 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.124443    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"618858fe-ec8a-439b-a23d-079db87a4d1a","Type":"ContainerStarted","Data":"c112681b344c3402812a1d57f0846a5b882db8e0530afb3a83e1fd26d677075c"}
Jul 16 13:42:41.151606 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.151549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.162567549 podStartE2EDuration="10.151511899s" totalImagesPullingTime="7.942631987s" totalInitContainerRuntime="46.312363ms" isStatefulPod=false podCreationTimestamp="2026-07-16 13:42:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:41.151362347 +0000 UTC m=+125.150394224" watchObservedRunningTime="2026-07-16 13:42:41.151511899 +0000 UTC m=+125.150543791"
Jul 16 13:42:41.887834 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:41.887760    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:42:42.128896 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:42.128863    2558 generic.go:356] "Generic (PLEG): container finished" podID="8fe5b7bc-0a11-4a86-b7eb-c71e746a9575" containerID="8486587d64767b91b2e606a9a4596ab5e6b9f7ad3edaed83e0b275eb7020c51f" exitCode=0
Jul 16 13:42:42.129264 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:42.128942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr" event={"ID":"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575","Type":"ContainerDied","Data":"8486587d64767b91b2e606a9a4596ab5e6b9f7ad3edaed83e0b275eb7020c51f"}
Jul 16 13:42:42.129725 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:42.129709    2558 scope.go:117] "RemoveContainer" containerID="8486587d64767b91b2e606a9a4596ab5e6b9f7ad3edaed83e0b275eb7020c51f"
Jul 16 13:42:43.134652 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:43.134609    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-q9prr" event={"ID":"8fe5b7bc-0a11-4a86-b7eb-c71e746a9575","Type":"ContainerStarted","Data":"38580901c0c0a982c15680fe9c39f353d81f1d9e5c47c5344170baf273f49dac"}
Jul 16 13:42:45.253050 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:45.253011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:42:45.255443 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:45.255410    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47dc235e-43e7-48c9-8d3d-473816e01efc-metrics-certs\") pod \"network-metrics-daemon-726ml\" (UID: \"47dc235e-43e7-48c9-8d3d-473816e01efc\") " pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:42:45.318559 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:45.318529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cxrw\""
Jul 16 13:42:45.326552 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:45.326531    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-726ml"
Jul 16 13:42:45.451077 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:45.451024    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-726ml"]
Jul 16 13:42:45.453637 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:42:45.453607    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47dc235e_43e7_48c9_8d3d_473816e01efc.slice/crio-7fb3a30b31b9cb2ec9423bb07a502d669b4efdca064c1b6d003d12b70104a551 WatchSource:0}: Error finding container 7fb3a30b31b9cb2ec9423bb07a502d669b4efdca064c1b6d003d12b70104a551: Status 404 returned error can't find the container with id 7fb3a30b31b9cb2ec9423bb07a502d669b4efdca064c1b6d003d12b70104a551
Jul 16 13:42:46.147631 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:46.147589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-726ml" event={"ID":"47dc235e-43e7-48c9-8d3d-473816e01efc","Type":"ContainerStarted","Data":"7fb3a30b31b9cb2ec9423bb07a502d669b4efdca064c1b6d003d12b70104a551"}
Jul 16 13:42:47.153850 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:47.153815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-726ml" event={"ID":"47dc235e-43e7-48c9-8d3d-473816e01efc","Type":"ContainerStarted","Data":"7f87b0bc9cb6d8024cbfee6fdb3533dd841e936935142f0c411952ef78f3086e"}
Jul 16 13:42:47.154257 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:47.153873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-726ml" event={"ID":"47dc235e-43e7-48c9-8d3d-473816e01efc","Type":"ContainerStarted","Data":"87ec697728545cd56b02b48fa91eab5f8b508163ebddca38ee142dcedc46cbd5"}
Jul 16 13:42:47.173125 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:42:47.173070    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-726ml" podStartSLOduration=130.196757554 podStartE2EDuration="2m11.173053493s" totalImagesPullingTime="976.295939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:42:47.171245056 +0000 UTC m=+131.170276956" watchObservedRunningTime="2026-07-16 13:42:47.173053493 +0000 UTC m=+131.172085370"
Jul 16 13:43:31.888176 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:43:31.888085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:43:31.906951 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:43:31.906927    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:43:32.332311 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:43:32.332286    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 13:45:36.318399 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:45:36.318370    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:45:36.321696 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:45:36.321668    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:45:36.322654 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:45:36.322632    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:45:36.326201 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:45:36.326170    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:45:36.330233 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:45:36.330215    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 13:46:23.039410 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.039380    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"]
Jul 16 13:46:23.042622 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.042605    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.066193 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.066173    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 13:46:23.066695 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.066668    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 13:46:23.066695 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.066672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dvv78\""
Jul 16 13:46:23.066863 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.066701    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 13:46:23.066863 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.066718    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 13:46:23.078509 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.078469    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"]
Jul 16 13:46:23.098512 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.098475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.098610 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.098531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-manifests\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.098610 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.098585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmh4l\" (UniqueName: \"kubernetes.io/projected/be46a2eb-a276-4997-b90f-25b83426ce46-kube-api-access-pmh4l\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.098692 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.098614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-webhook-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.098692 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.098676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-tmp\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.199625 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.199588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-tmp\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.199774 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.199657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.199774 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.199695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-manifests\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.199774 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.199733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmh4l\" (UniqueName: \"kubernetes.io/projected/be46a2eb-a276-4997-b90f-25b83426ce46-kube-api-access-pmh4l\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.199774 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.199768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-webhook-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.200109 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.200077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-manifests\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.202117 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.202092    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be46a2eb-a276-4997-b90f-25b83426ce46-tmp\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.202198 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.202173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-webhook-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.202240 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.202220    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/be46a2eb-a276-4997-b90f-25b83426ce46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.212773 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.212753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmh4l\" (UniqueName: \"kubernetes.io/projected/be46a2eb-a276-4997-b90f-25b83426ce46-kube-api-access-pmh4l\") pod \"opendatahub-operator-controller-manager-558d6dc665-dlxps\" (UID: \"be46a2eb-a276-4997-b90f-25b83426ce46\") " pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.352812 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.352783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:23.490126 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.490100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"]
Jul 16 13:46:23.492696 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:46:23.492672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe46a2eb_a276_4997_b90f_25b83426ce46.slice/crio-ea6b87c72fede8f797fd81661214d16766528f769bb45d95f01c592f90542021 WatchSource:0}: Error finding container ea6b87c72fede8f797fd81661214d16766528f769bb45d95f01c592f90542021: Status 404 returned error can't find the container with id ea6b87c72fede8f797fd81661214d16766528f769bb45d95f01c592f90542021
Jul 16 13:46:23.494520 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.494502    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:46:23.910340 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:23.910304    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps" event={"ID":"be46a2eb-a276-4997-b90f-25b83426ce46","Type":"ContainerStarted","Data":"ea6b87c72fede8f797fd81661214d16766528f769bb45d95f01c592f90542021"}
Jul 16 13:46:26.923253 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:26.923212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps" event={"ID":"be46a2eb-a276-4997-b90f-25b83426ce46","Type":"ContainerStarted","Data":"0cf5d6ada8f499bb8d93bc39c9958fb4a1f791a37466bfa259eaf0a57e85d238"}
Jul 16 13:46:27.927983 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:27.927898    2558 generic.go:356] "Generic (PLEG): container finished" podID="be46a2eb-a276-4997-b90f-25b83426ce46" containerID="0cf5d6ada8f499bb8d93bc39c9958fb4a1f791a37466bfa259eaf0a57e85d238" exitCode=0
Jul 16 13:46:27.928315 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:27.927981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps" event={"ID":"be46a2eb-a276-4997-b90f-25b83426ce46","Type":"ContainerDied","Data":"0cf5d6ada8f499bb8d93bc39c9958fb4a1f791a37466bfa259eaf0a57e85d238"}
Jul 16 13:46:28.933687 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:28.933648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps" event={"ID":"be46a2eb-a276-4997-b90f-25b83426ce46","Type":"ContainerStarted","Data":"dca439c8dbfb6692796944ea11b9b2cdd17866a860c3af0dd31359fd3cfee159"}
Jul 16 13:46:28.934068 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:28.933778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:28.978870 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:28.978815    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps" podStartSLOduration=2.526023885 podStartE2EDuration="6.978797428s" totalImagesPullingTime="3.373357689s" totalInitContainerRuntime="1.079415854s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:46:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:46:28.976633391 +0000 UTC m=+352.975665287" watchObservedRunningTime="2026-07-16 13:46:28.978797428 +0000 UTC m=+352.977829305"
Jul 16 13:46:39.940232 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:39.940203    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-558d6dc665-dlxps"
Jul 16 13:46:52.116092 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.116052    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"]
Jul 16 13:46:52.130238 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.130205    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.136934 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.136781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 13:46:52.137279 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.137253    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 13:46:52.137396 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.137281    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 13:46:52.137913 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.137892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4jfgw\""
Jul 16 13:46:52.150314 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.150290    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"]
Jul 16 13:46:52.236958 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.236927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237130 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.236965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237130 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.236984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237130 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237130 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237265 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237265 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237198    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kz67\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-kube-api-access-4kz67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237265 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.237352 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.237275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.337861 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.337861 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kz67\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-kube-api-access-4kz67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.337991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338121 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338476 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338476 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338476 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338673 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.338724 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.338665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.340356 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.340330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.340456 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.340358    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.358250 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.358218    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kz67\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-kube-api-access-4kz67\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.358673 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.358656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8d7fda0-3f20-4426-8026-1e4ed49c0e9d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lnt87\" (UID: \"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.440869 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.440808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:52.529865 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.529833    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"]
Jul 16 13:46:52.533858 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.533832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.536315 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.536295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 13:46:52.536453 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.536352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 13:46:52.536697 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.536681    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 13:46:52.537384 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.537368    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 13:46:52.538187 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.538170    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vg8wk\""
Jul 16 13:46:52.538997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.538982    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 13:46:52.550390 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.550362    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"]
Jul 16 13:46:52.589782 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.589705    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"]
Jul 16 13:46:52.592004 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:46:52.591976    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d7fda0_3f20_4426_8026_1e4ed49c0e9d.slice/crio-e0628fa419253fb17eca9e08b2e1d9de21d2b8ba5d70fc5b3231ba13446ade08 WatchSource:0}: Error finding container e0628fa419253fb17eca9e08b2e1d9de21d2b8ba5d70fc5b3231ba13446ade08: Status 404 returned error can't find the container with id e0628fa419253fb17eca9e08b2e1d9de21d2b8ba5d70fc5b3231ba13446ade08
Jul 16 13:46:52.640504 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.640466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-metrics-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.640647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.640514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbqg\" (UniqueName: \"kubernetes.io/projected/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-kube-api-access-pnbqg\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.640647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.640536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-manager-config\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.640647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.640605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.741466 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.741380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-metrics-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.741466 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.741414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbqg\" (UniqueName: \"kubernetes.io/projected/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-kube-api-access-pnbqg\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.741466 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.741432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-manager-config\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.741780 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.741568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.742147 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.742127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-manager-config\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.743869 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.743852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-metrics-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.743938 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.743876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-cert\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.772291 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.772255    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbqg\" (UniqueName: \"kubernetes.io/projected/9a6258e6-3bfc-47ca-8df2-10f20daea3d8-kube-api-access-pnbqg\") pod \"lws-controller-manager-6769696c89-j8tt5\" (UID: \"9a6258e6-3bfc-47ca-8df2-10f20daea3d8\") " pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:52.846424 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:52.846389    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:53.019696 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:53.019617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87" event={"ID":"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d","Type":"ContainerStarted","Data":"e0628fa419253fb17eca9e08b2e1d9de21d2b8ba5d70fc5b3231ba13446ade08"}
Jul 16 13:46:53.042109 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:53.042076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"]
Jul 16 13:46:53.044920 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:46:53.044901    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6258e6_3bfc_47ca_8df2_10f20daea3d8.slice/crio-e0e18f3641ba994c0c3d919f797dfcb17184646df981edc5911d40b99b2dd8d8 WatchSource:0}: Error finding container e0e18f3641ba994c0c3d919f797dfcb17184646df981edc5911d40b99b2dd8d8: Status 404 returned error can't find the container with id e0e18f3641ba994c0c3d919f797dfcb17184646df981edc5911d40b99b2dd8d8
Jul 16 13:46:54.027462 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:54.027415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5" event={"ID":"9a6258e6-3bfc-47ca-8df2-10f20daea3d8","Type":"ContainerStarted","Data":"e0e18f3641ba994c0c3d919f797dfcb17184646df981edc5911d40b99b2dd8d8"}
Jul 16 13:46:55.004855 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.004478    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"]
Jul 16 13:46:55.008187 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.008165    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"]
Jul 16 13:46:55.008319 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.008288    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.011580 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.011560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.012833 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.012812    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 13:46:55.013427 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.013407    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8v9f9\""
Jul 16 13:46:55.014162 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.014143    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 13:46:55.014280 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.014260    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-r6nlw\""
Jul 16 13:46:55.023362 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.023175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"]
Jul 16 13:46:55.025025 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.024969    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"]
Jul 16 13:46:55.163082 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.163041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.163595 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.163105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc0b624-bd3f-4826-b561-73c50db4e0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.163595 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.163149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbgw\" (UniqueName: \"kubernetes.io/projected/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-kube-api-access-9rbgw\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.163595 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.163209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5wx\" (UniqueName: \"kubernetes.io/projected/edc0b624-bd3f-4826-b561-73c50db4e0a7-kube-api-access-zm5wx\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.264144 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.264072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.264144 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.264124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc0b624-bd3f-4826-b561-73c50db4e0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.264377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.264157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbgw\" (UniqueName: \"kubernetes.io/projected/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-kube-api-access-9rbgw\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.264377 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.264196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5wx\" (UniqueName: \"kubernetes.io/projected/edc0b624-bd3f-4826-b561-73c50db4e0a7-kube-api-access-zm5wx\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.264377 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:46:55.264253    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 13:46:55.264377 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:46:55.264329    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert podName:e7b6ef65-1204-4be7-b4c7-8ae098a17b53 nodeName:}" failed. No retries permitted until 2026-07-16 13:46:55.764308171 +0000 UTC m=+379.763340029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert") pod "llmisvc-controller-manager-777c6bd7d5-hslsf" (UID: "e7b6ef65-1204-4be7-b4c7-8ae098a17b53") : secret "llmisvc-webhook-server-cert" not found
Jul 16 13:46:55.266917 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.266888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/edc0b624-bd3f-4826-b561-73c50db4e0a7-cert\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.275819 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.275798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbgw\" (UniqueName: \"kubernetes.io/projected/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-kube-api-access-9rbgw\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.277355 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.277332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5wx\" (UniqueName: \"kubernetes.io/projected/edc0b624-bd3f-4826-b561-73c50db4e0a7-kube-api-access-zm5wx\") pod \"kserve-controller-manager-d6f4b65b8-z8qc2\" (UID: \"edc0b624-bd3f-4826-b561-73c50db4e0a7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.323161 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.323130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:55.769540 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.769484    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.772128 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.772105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e7b6ef65-1204-4be7-b4c7-8ae098a17b53-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hslsf\" (UID: \"e7b6ef65-1204-4be7-b4c7-8ae098a17b53\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:55.931002 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:55.930962    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:46:56.271241 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:56.271170    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 13:46:56.271641 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:56.271264    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 13:46:56.271641 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:56.271298    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 13:46:56.439674 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:56.439644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"]
Jul 16 13:46:56.448508 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:46:56.448449    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7b6ef65_1204_4be7_b4c7_8ae098a17b53.slice/crio-ff79725702e1fea7bda2741bb3136131f4b0071af70db41c1be878198e5e22a0 WatchSource:0}: Error finding container ff79725702e1fea7bda2741bb3136131f4b0071af70db41c1be878198e5e22a0: Status 404 returned error can't find the container with id ff79725702e1fea7bda2741bb3136131f4b0071af70db41c1be878198e5e22a0
Jul 16 13:46:56.493526 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:46:56.493464    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc0b624_bd3f_4826_b561_73c50db4e0a7.slice/crio-c404342a6b7aa16079c0d84df28e4e392198774e4fa42dfd4709439e10f0972a WatchSource:0}: Error finding container c404342a6b7aa16079c0d84df28e4e392198774e4fa42dfd4709439e10f0972a: Status 404 returned error can't find the container with id c404342a6b7aa16079c0d84df28e4e392198774e4fa42dfd4709439e10f0972a
Jul 16 13:46:56.501156 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:56.501102    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"]
Jul 16 13:46:57.044556 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.044513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87" event={"ID":"d8d7fda0-3f20-4426-8026-1e4ed49c0e9d","Type":"ContainerStarted","Data":"cd1fc72bdb25076cfe7b71e8e53800cbc003e134283b56ea9a5e95f51ff33cce"}
Jul 16 13:46:57.046000 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.045957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2" event={"ID":"edc0b624-bd3f-4826-b561-73c50db4e0a7","Type":"ContainerStarted","Data":"c404342a6b7aa16079c0d84df28e4e392198774e4fa42dfd4709439e10f0972a"}
Jul 16 13:46:57.047796 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.047765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5" event={"ID":"9a6258e6-3bfc-47ca-8df2-10f20daea3d8","Type":"ContainerStarted","Data":"0a22846514b36e0068391eb58d179eb628bc94751c9272c74d5f3b9f590731a4"}
Jul 16 13:46:57.047925 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.047874    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:46:57.049015 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.048984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf" event={"ID":"e7b6ef65-1204-4be7-b4c7-8ae098a17b53","Type":"ContainerStarted","Data":"ff79725702e1fea7bda2741bb3136131f4b0071af70db41c1be878198e5e22a0"}
Jul 16 13:46:57.068745 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.068697    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87" podStartSLOduration=1.3917529659999999 podStartE2EDuration="5.068678457s" totalImagesPullingTime="3.676925491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:46:57.068006294 +0000 UTC m=+381.067038198" watchObservedRunningTime="2026-07-16 13:46:57.068678457 +0000 UTC m=+381.067710336"
Jul 16 13:46:57.087474 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.087424    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5" podStartSLOduration=1.797470414 podStartE2EDuration="5.087410024s" totalImagesPullingTime="3.28993961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:46:57.086338028 +0000 UTC m=+381.085369904" watchObservedRunningTime="2026-07-16 13:46:57.087410024 +0000 UTC m=+381.086441901"
Jul 16 13:46:57.441663 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.441624    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:57.446814 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:57.446786    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:58.055523 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:58.055199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:58.056076 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:58.056047    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lnt87"
Jul 16 13:46:59.061856 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:59.061817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2" event={"ID":"edc0b624-bd3f-4826-b561-73c50db4e0a7","Type":"ContainerStarted","Data":"baa5c48f0e48d82e7953b8a0bdca0831e3a994b5794229206a906305cab5910a"}
Jul 16 13:46:59.062305 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:59.061979    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:46:59.079073 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:46:59.079028    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2" podStartSLOduration=2.778287755 podStartE2EDuration="5.079007453s" totalImagesPullingTime="2.300719698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:46:59.078392893 +0000 UTC m=+383.077424795" watchObservedRunningTime="2026-07-16 13:46:59.079007453 +0000 UTC m=+383.078039348"
Jul 16 13:47:00.067332 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:00.067292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf" event={"ID":"e7b6ef65-1204-4be7-b4c7-8ae098a17b53","Type":"ContainerStarted","Data":"ae472651faaddf2c9e90b9c2b0b1b8a611531efd19e2b4deff94701dbe9889cf"}
Jul 16 13:47:00.086148 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:00.086098    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf" podStartSLOduration=2.949860692 podStartE2EDuration="6.08608277s" totalImagesPullingTime="3.136222078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:47:00.084677068 +0000 UTC m=+384.083708945" watchObservedRunningTime="2026-07-16 13:47:00.08608277 +0000 UTC m=+384.085114647"
Jul 16 13:47:01.073530 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:01.073185    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:47:08.056745 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:08.056717    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6769696c89-j8tt5"
Jul 16 13:47:30.073012 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:30.072982    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-z8qc2"
Jul 16 13:47:32.078844 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:47:32.078809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hslsf"
Jul 16 13:48:50.918828 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.918797    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"]
Jul 16 13:48:50.924638 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.922909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:50.927137 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.927048    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 13:48:50.927373 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.927352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 13:48:50.928155 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.928127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wf26d\""
Jul 16 13:48:50.938784 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:50.938765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"]
Jul 16 13:48:51.011386 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.011350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fc5p\" (UniqueName: \"kubernetes.io/projected/d5d0a908-b706-4ec7-9793-a02aba39dad2-kube-api-access-6fc5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b8j8h\" (UID: \"d5d0a908-b706-4ec7-9793-a02aba39dad2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:51.112703 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.112667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fc5p\" (UniqueName: \"kubernetes.io/projected/d5d0a908-b706-4ec7-9793-a02aba39dad2-kube-api-access-6fc5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b8j8h\" (UID: \"d5d0a908-b706-4ec7-9793-a02aba39dad2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:51.122264 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.122238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fc5p\" (UniqueName: \"kubernetes.io/projected/d5d0a908-b706-4ec7-9793-a02aba39dad2-kube-api-access-6fc5p\") pod \"limitador-operator-controller-manager-859d7b78bd-b8j8h\" (UID: \"d5d0a908-b706-4ec7-9793-a02aba39dad2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:51.236803 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.236724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:51.367348 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.367319    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"]
Jul 16 13:48:51.370047 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:48:51.370023    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d0a908_b706_4ec7_9793_a02aba39dad2.slice/crio-111ff9bf821382b27c58bf6eb9a9004e7575c76ac02e6f2c336f8c90f5da66a2 WatchSource:0}: Error finding container 111ff9bf821382b27c58bf6eb9a9004e7575c76ac02e6f2c336f8c90f5da66a2: Status 404 returned error can't find the container with id 111ff9bf821382b27c58bf6eb9a9004e7575c76ac02e6f2c336f8c90f5da66a2
Jul 16 13:48:51.529357 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:51.529272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h" event={"ID":"d5d0a908-b706-4ec7-9793-a02aba39dad2","Type":"ContainerStarted","Data":"111ff9bf821382b27c58bf6eb9a9004e7575c76ac02e6f2c336f8c90f5da66a2"}
Jul 16 13:48:53.538253 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:53.538221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h" event={"ID":"d5d0a908-b706-4ec7-9793-a02aba39dad2","Type":"ContainerStarted","Data":"dcca595f7f54969d5c4a097d32950e52923c3a9d723d149a506fb4fa470a40a5"}
Jul 16 13:48:53.538688 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:53.538345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:48:53.562445 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:48:53.562400    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h" podStartSLOduration=1.9559710049999999 podStartE2EDuration="3.562386303s" totalImagesPullingTime="1.606415298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:48:53.56107148 +0000 UTC m=+497.560103357" watchObservedRunningTime="2026-07-16 13:48:53.562386303 +0000 UTC m=+497.561418179"
Jul 16 13:49:04.544585 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:49:04.544548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-b8j8h"
Jul 16 13:50:22.660273 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.660240    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:22.663644 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.663627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.670482 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:22.670452    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-controller-dockercfg-nhdtv\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhdtv\"" type="*v1.Secret"
Jul 16 13:50:22.670767 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:22.670741    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"maas-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" type="*v1.Secret"
Jul 16 13:50:22.670767 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:22.670748    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-controller-755bdf6446-zlgzn\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.670911 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:22.670770    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"maas-parameters\" is forbidden: User \"system:node:ip-10-0-137-62.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-62.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"maas-parameters\"" type="*v1.ConfigMap"
Jul 16 13:50:22.691382 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.691357    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:22.797932 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.797900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.798093 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.797949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4z2c\" (UniqueName: \"kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.899298 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.899270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.899437 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.899313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4z2c\" (UniqueName: \"kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.918338 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.918274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4z2c\" (UniqueName: \"kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:22.926802 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.926781    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:50:22.930118 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.930102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:22.948446 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:22.948424    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:50:23.000118 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.000088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwsq\" (UniqueName: \"kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:23.000233 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.000131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:23.101207 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.101180    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwsq\" (UniqueName: \"kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:23.101314 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.101223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:23.112395 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.112372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwsq\" (UniqueName: \"kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:23.518404 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.518376    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 13:50:23.868646 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:23.868616    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhdtv\""
Jul 16 13:50:23.900225 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:23.900198    2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: failed to sync secret cache: timed out waiting for the condition
Jul 16 13:50:23.900317 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:23.900279    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert podName:17beeefe-6e15-41ad-aedc-02c1881b4112 nodeName:}" failed. No retries permitted until 2026-07-16 13:50:24.400259707 +0000 UTC m=+588.399291565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert") pod "maas-controller-755bdf6446-zlgzn" (UID: "17beeefe-6e15-41ad-aedc-02c1881b4112") : failed to sync secret cache: timed out waiting for the condition
Jul 16 13:50:24.020554 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.020526    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 13:50:24.023740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.023717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert\") pod \"maas-controller-97689c86b-8rkmj\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") " pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:24.140484 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.140393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:24.268010 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.267983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:50:24.270468 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:50:24.270437    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d414f5f_cab1_4a78_a1be_773b671cbbb6.slice/crio-a56b131fff8dd1e8c1302c419593b6f7fb206b704ad7cc8263189cba7e9608a5 WatchSource:0}: Error finding container a56b131fff8dd1e8c1302c419593b6f7fb206b704ad7cc8263189cba7e9608a5: Status 404 returned error can't find the container with id a56b131fff8dd1e8c1302c419593b6f7fb206b704ad7cc8263189cba7e9608a5
Jul 16 13:50:24.410225 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.410137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:24.412562 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.412530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") pod \"maas-controller-755bdf6446-zlgzn\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") " pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:24.473716 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.473685    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:24.601767 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.601746    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:24.603469 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:50:24.603442    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17beeefe_6e15_41ad_aedc_02c1881b4112.slice/crio-67716166596a11833c6e56b6b1b55aac1f23f619eebaece3e0286886f24bd9e7 WatchSource:0}: Error finding container 67716166596a11833c6e56b6b1b55aac1f23f619eebaece3e0286886f24bd9e7: Status 404 returned error can't find the container with id 67716166596a11833c6e56b6b1b55aac1f23f619eebaece3e0286886f24bd9e7
Jul 16 13:50:24.920449 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.920407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf6446-zlgzn" event={"ID":"17beeefe-6e15-41ad-aedc-02c1881b4112","Type":"ContainerStarted","Data":"67716166596a11833c6e56b6b1b55aac1f23f619eebaece3e0286886f24bd9e7"}
Jul 16 13:50:24.921593 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:24.921564    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-8rkmj" event={"ID":"0d414f5f-cab1-4a78-a1be-773b671cbbb6","Type":"ContainerStarted","Data":"a56b131fff8dd1e8c1302c419593b6f7fb206b704ad7cc8263189cba7e9608a5"}
Jul 16 13:50:27.939138 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:27.939102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf6446-zlgzn" event={"ID":"17beeefe-6e15-41ad-aedc-02c1881b4112","Type":"ContainerStarted","Data":"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"}
Jul 16 13:50:27.939622 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:27.939169    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:27.940560 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:27.940537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-8rkmj" event={"ID":"0d414f5f-cab1-4a78-a1be-773b671cbbb6","Type":"ContainerStarted","Data":"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"}
Jul 16 13:50:27.940639 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:27.940591    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:27.956584 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:27.956537    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-755bdf6446-zlgzn" podStartSLOduration=3.336276522 podStartE2EDuration="5.956522112s" totalImagesPullingTime="2.62024559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:50:27.955133177 +0000 UTC m=+591.954165080" watchObservedRunningTime="2026-07-16 13:50:27.956522112 +0000 UTC m=+591.955553988"
Jul 16 13:50:36.347129 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:36.347096    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:50:36.347601 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:36.347581    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:50:36.349996 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:36.349979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:50:36.350402 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:36.350380    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:50:38.946959 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:38.946927    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:50:38.947324 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:38.947009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:38.971621 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:38.971556    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-97689c86b-8rkmj" podStartSLOduration=14.011178437 podStartE2EDuration="16.971535398s" totalImagesPullingTime="2.960356961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:50:27.972541271 +0000 UTC m=+591.971573149" watchObservedRunningTime="2026-07-16 13:50:38.971535398 +0000 UTC m=+602.970567287"
Jul 16 13:50:39.019098 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.019061    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:39.019300 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.019261    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-755bdf6446-zlgzn" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" containerName="manager" containerID="cri-o://db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0" gracePeriod=30
Jul 16 13:50:39.258632 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.258610    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:39.337920 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.337887    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4z2c\" (UniqueName: \"kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c\") pod \"17beeefe-6e15-41ad-aedc-02c1881b4112\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") "
Jul 16 13:50:39.337920 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.337924    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") pod \"17beeefe-6e15-41ad-aedc-02c1881b4112\" (UID: \"17beeefe-6e15-41ad-aedc-02c1881b4112\") "
Jul 16 13:50:39.340104 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.340079    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "17beeefe-6e15-41ad-aedc-02c1881b4112" (UID: "17beeefe-6e15-41ad-aedc-02c1881b4112"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:50:39.340211 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.340127    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c" (OuterVolumeSpecName: "kube-api-access-l4z2c") pod "17beeefe-6e15-41ad-aedc-02c1881b4112" (UID: "17beeefe-6e15-41ad-aedc-02c1881b4112"). InnerVolumeSpecName "kube-api-access-l4z2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:50:39.438786 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.438749    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4z2c\" (UniqueName: \"kubernetes.io/projected/17beeefe-6e15-41ad-aedc-02c1881b4112-kube-api-access-l4z2c\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:50:39.438786 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.438780    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17beeefe-6e15-41ad-aedc-02c1881b4112-webhook-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:50:39.995405 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.995367    2558 generic.go:356] "Generic (PLEG): container finished" podID="17beeefe-6e15-41ad-aedc-02c1881b4112" containerID="db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0" exitCode=0
Jul 16 13:50:39.995806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.995415    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-755bdf6446-zlgzn"
Jul 16 13:50:39.995806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.995452    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf6446-zlgzn" event={"ID":"17beeefe-6e15-41ad-aedc-02c1881b4112","Type":"ContainerDied","Data":"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"}
Jul 16 13:50:39.995806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.995521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-755bdf6446-zlgzn" event={"ID":"17beeefe-6e15-41ad-aedc-02c1881b4112","Type":"ContainerDied","Data":"67716166596a11833c6e56b6b1b55aac1f23f619eebaece3e0286886f24bd9e7"}
Jul 16 13:50:39.995806 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:39.995546    2558 scope.go:117] "RemoveContainer" containerID="db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"
Jul 16 13:50:40.004500 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:40.004472    2558 scope.go:117] "RemoveContainer" containerID="db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"
Jul 16 13:50:40.004745 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:50:40.004728    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0\": container with ID starting with db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0 not found: ID does not exist" containerID="db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"
Jul 16 13:50:40.004813 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:40.004752    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0"} err="failed to get container status \"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0\": rpc error: code = NotFound desc = could not find container \"db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0\": container with ID starting with db951350ad6bb075078c4432e1e86638927ccb036046b2003c765aca9c2d65a0 not found: ID does not exist"
Jul 16 13:50:40.018940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:40.018915    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:40.023323 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:40.023302    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-755bdf6446-zlgzn"]
Jul 16 13:50:40.509791 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:40.509761    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" path="/var/lib/kubelet/pods/17beeefe-6e15-41ad-aedc-02c1881b4112/volumes"
Jul 16 13:50:58.810482 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.810389    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"]
Jul 16 13:50:58.811063 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.810905    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" containerName="manager"
Jul 16 13:50:58.811063 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.810925    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" containerName="manager"
Jul 16 13:50:58.811063 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.811008    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="17beeefe-6e15-41ad-aedc-02c1881b4112" containerName="manager"
Jul 16 13:50:58.818356 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.818328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:58.822143 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.822116    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 13:50:58.822282 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.822242    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 13:50:58.822282 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.822273    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 13:50:58.829751 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.829726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"]
Jul 16 13:50:58.903722 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.903685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d251193-4066-4f9d-973f-3b88b81af9f0-maas-api-tls\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:58.903892 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.903733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d251193-4066-4f9d-973f-3b88b81af9f0-openshift-service-ca\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:58.903892 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:58.903760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4k6\" (UniqueName: \"kubernetes.io/projected/1d251193-4066-4f9d-973f-3b88b81af9f0-kube-api-access-6z4k6\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.004609 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.004576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4k6\" (UniqueName: \"kubernetes.io/projected/1d251193-4066-4f9d-973f-3b88b81af9f0-kube-api-access-6z4k6\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.004802 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.004744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d251193-4066-4f9d-973f-3b88b81af9f0-maas-api-tls\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.004802 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.004799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d251193-4066-4f9d-973f-3b88b81af9f0-openshift-service-ca\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.005440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.005415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d251193-4066-4f9d-973f-3b88b81af9f0-openshift-service-ca\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.007265 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.007240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d251193-4066-4f9d-973f-3b88b81af9f0-maas-api-tls\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.016290 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.016270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4k6\" (UniqueName: \"kubernetes.io/projected/1d251193-4066-4f9d-973f-3b88b81af9f0-kube-api-access-6z4k6\") pod \"maas-api-646c9c8cc7-r24l9\" (UID: \"1d251193-4066-4f9d-973f-3b88b81af9f0\") " pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.129385 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.129287    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:50:59.270456 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.270430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"]
Jul 16 13:50:59.272750 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:50:59.272721    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d251193_4066_4f9d_973f_3b88b81af9f0.slice/crio-f338012eea56b85a10360b4a31195f702a9fee3e0857fbfdc598367707b14339 WatchSource:0}: Error finding container f338012eea56b85a10360b4a31195f702a9fee3e0857fbfdc598367707b14339: Status 404 returned error can't find the container with id f338012eea56b85a10360b4a31195f702a9fee3e0857fbfdc598367707b14339
Jul 16 13:50:59.654159 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.654125    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"]
Jul 16 13:50:59.659086 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.659065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.665709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.665686    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 13:50:59.665709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.665704    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5mndj\""
Jul 16 13:50:59.673095 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.673070    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"]
Jul 16 13:50:59.710709 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.710675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79fd2a3f-5686-4159-90dc-ddfdffc093dd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.710857 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.710713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9hc4\" (UniqueName: \"kubernetes.io/projected/79fd2a3f-5686-4159-90dc-ddfdffc093dd-kube-api-access-w9hc4\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.812300 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.812266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79fd2a3f-5686-4159-90dc-ddfdffc093dd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.812839 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.812807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9hc4\" (UniqueName: \"kubernetes.io/projected/79fd2a3f-5686-4159-90dc-ddfdffc093dd-kube-api-access-w9hc4\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.813108 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.813088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79fd2a3f-5686-4159-90dc-ddfdffc093dd-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.822170 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.822149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9hc4\" (UniqueName: \"kubernetes.io/projected/79fd2a3f-5686-4159-90dc-ddfdffc093dd-kube-api-access-w9hc4\") pod \"payload-pre-processing-74584bb9f8-bwscm\" (UID: \"79fd2a3f-5686-4159-90dc-ddfdffc093dd\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:50:59.970081 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:50:59.969991    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:51:00.081221 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:00.081187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9" event={"ID":"1d251193-4066-4f9d-973f-3b88b81af9f0","Type":"ContainerStarted","Data":"f338012eea56b85a10360b4a31195f702a9fee3e0857fbfdc598367707b14339"}
Jul 16 13:51:00.113589 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:00.113555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"]
Jul 16 13:51:00.116095 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:51:00.116063    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fd2a3f_5686_4159_90dc_ddfdffc093dd.slice/crio-90f4ea7399f49d698057c4f47387ed0e58c61be944eefee964eea89c6f92a180 WatchSource:0}: Error finding container 90f4ea7399f49d698057c4f47387ed0e58c61be944eefee964eea89c6f92a180: Status 404 returned error can't find the container with id 90f4ea7399f49d698057c4f47387ed0e58c61be944eefee964eea89c6f92a180
Jul 16 13:51:01.088684 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:01.088642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm" event={"ID":"79fd2a3f-5686-4159-90dc-ddfdffc093dd","Type":"ContainerStarted","Data":"90f4ea7399f49d698057c4f47387ed0e58c61be944eefee964eea89c6f92a180"}
Jul 16 13:51:02.095686 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.095593    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9" event={"ID":"1d251193-4066-4f9d-973f-3b88b81af9f0","Type":"ContainerStarted","Data":"9520b227fc8b95190ff9e901023eab0ca911465e1ea3fe3f0531ba97b717869f"}
Jul 16 13:51:02.096101 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.095700    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:51:02.097314 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.097291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm" event={"ID":"79fd2a3f-5686-4159-90dc-ddfdffc093dd","Type":"ContainerStarted","Data":"9ad1a66f548fad052e9703cb6e18e93b185c75d9afb81b9874f3523b675a2fb4"}
Jul 16 13:51:02.097438 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.097344    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:51:02.117178 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.117129    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9" podStartSLOduration=1.569098723 podStartE2EDuration="4.11711504s" totalImagesPullingTime="2.548016317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:51:02.114872261 +0000 UTC m=+626.113904152" watchObservedRunningTime="2026-07-16 13:51:02.11711504 +0000 UTC m=+626.116146916"
Jul 16 13:51:02.131960 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:02.131914    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm" podStartSLOduration=1.425721367 podStartE2EDuration="3.131900594s" totalImagesPullingTime="1.706179227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:51:02.130612213 +0000 UTC m=+626.129644117" watchObservedRunningTime="2026-07-16 13:51:02.131900594 +0000 UTC m=+626.130932469"
Jul 16 13:51:08.107143 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:08.107113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-646c9c8cc7-r24l9"
Jul 16 13:51:13.103672 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:13.103638    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-bwscm"
Jul 16 13:51:24.244744 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.244712    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"]
Jul 16 13:51:24.248153 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.248138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.250891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.250867    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 13:51:24.250891 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.250871    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-krq85\""
Jul 16 13:51:24.252035 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.252018    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 13:51:24.252119 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.252059    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 13:51:24.265636 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.265610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"]
Jul 16 13:51:24.327747 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.327722    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.327852 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.327776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.327897 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.327879    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.327939 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.327927    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3a8b629-610a-49ea-85c3-7609cff95e71-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.327988 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.327954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.328031 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.328005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zj6n\" (UniqueName: \"kubernetes.io/projected/f3a8b629-610a-49ea-85c3-7609cff95e71-kube-api-access-6zj6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428837 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zj6n\" (UniqueName: \"kubernetes.io/projected/f3a8b629-610a-49ea-85c3-7609cff95e71-kube-api-access-6zj6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3a8b629-610a-49ea-85c3-7609cff95e71-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.428997 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.428950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.429333 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.429297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.429416 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.429363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.429416 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.429397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.431140 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.431121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3a8b629-610a-49ea-85c3-7609cff95e71-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.431392 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.431372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3a8b629-610a-49ea-85c3-7609cff95e71-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.438419 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.438388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zj6n\" (UniqueName: \"kubernetes.io/projected/f3a8b629-610a-49ea-85c3-7609cff95e71-kube-api-access-6zj6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk\" (UID: \"f3a8b629-610a-49ea-85c3-7609cff95e71\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.558167 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.558149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:24.688533 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.688501    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"]
Jul 16 13:51:24.691535 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:51:24.691506    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a8b629_610a_49ea_85c3_7609cff95e71.slice/crio-6aca1cfecc91a916bf560f161285c753f3538f06ce3e673f4d0a17a8422c04e3 WatchSource:0}: Error finding container 6aca1cfecc91a916bf560f161285c753f3538f06ce3e673f4d0a17a8422c04e3: Status 404 returned error can't find the container with id 6aca1cfecc91a916bf560f161285c753f3538f06ce3e673f4d0a17a8422c04e3
Jul 16 13:51:24.693086 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:24.693068    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 13:51:25.201066 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:25.200988    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk" event={"ID":"f3a8b629-610a-49ea-85c3-7609cff95e71","Type":"ContainerStarted","Data":"6aca1cfecc91a916bf560f161285c753f3538f06ce3e673f4d0a17a8422c04e3"}
Jul 16 13:51:26.207111 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:26.207070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk" event={"ID":"f3a8b629-610a-49ea-85c3-7609cff95e71","Type":"ContainerStarted","Data":"bb5e5bb29d2beee332273e308362913357629a616e3977b919297c391611e945"}
Jul 16 13:51:26.226800 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:26.226749    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk" podStartSLOduration=0.900395519 podStartE2EDuration="2.22673294s" totalImagesPullingTime="1.326337421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:51:26.226335203 +0000 UTC m=+650.225367125" watchObservedRunningTime="2026-07-16 13:51:26.22673294 +0000 UTC m=+650.225764808"
Jul 16 13:51:30.841068 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.841035    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"]
Jul 16 13:51:30.844228 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.844211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.848147 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.848124    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 16 13:51:30.863577 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.863555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"]
Jul 16 13:51:30.986105 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.986250 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.986250 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkdbt\" (UniqueName: \"kubernetes.io/projected/b711df3d-0615-4bdd-b381-4e5387e0f592-kube-api-access-fkdbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.986250 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.986380 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:30.986380 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:30.986327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b711df3d-0615-4bdd-b381-4e5387e0f592-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087574 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b711df3d-0615-4bdd-b381-4e5387e0f592-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkdbt\" (UniqueName: \"kubernetes.io/projected/b711df3d-0615-4bdd-b381-4e5387e0f592-kube-api-access-fkdbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.087740 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.087739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.088101 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.088080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.088190 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.088168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.088227 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.088194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.089876 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.089851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b711df3d-0615-4bdd-b381-4e5387e0f592-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.090120 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.090104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b711df3d-0615-4bdd-b381-4e5387e0f592-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.101480 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.101414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkdbt\" (UniqueName: \"kubernetes.io/projected/b711df3d-0615-4bdd-b381-4e5387e0f592-kube-api-access-fkdbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-55mxl\" (UID: \"b711df3d-0615-4bdd-b381-4e5387e0f592\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.154550 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.154523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:31.288940 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:31.288917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"]
Jul 16 13:51:31.290801 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:51:31.290776    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb711df3d_0615_4bdd_b381_4e5387e0f592.slice/crio-3b0fde4ef2bfaf892e9616a0d6c5f2c4ec8d86c689a62c38fe03ec1b376378ab WatchSource:0}: Error finding container 3b0fde4ef2bfaf892e9616a0d6c5f2c4ec8d86c689a62c38fe03ec1b376378ab: Status 404 returned error can't find the container with id 3b0fde4ef2bfaf892e9616a0d6c5f2c4ec8d86c689a62c38fe03ec1b376378ab
Jul 16 13:51:32.234380 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:32.234348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl" event={"ID":"b711df3d-0615-4bdd-b381-4e5387e0f592","Type":"ContainerStarted","Data":"2728b0dee47da4211ca08bbdf0810522f1c40ce59dd1384e3605f63f55b31cc7"}
Jul 16 13:51:32.234776 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:32.234398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl" event={"ID":"b711df3d-0615-4bdd-b381-4e5387e0f592","Type":"ContainerStarted","Data":"3b0fde4ef2bfaf892e9616a0d6c5f2c4ec8d86c689a62c38fe03ec1b376378ab"}
Jul 16 13:51:32.254626 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:32.254580    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl" podStartSLOduration=2.057380038 podStartE2EDuration="2.254564583s" totalImagesPullingTime="197.184545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:51:32.253841729 +0000 UTC m=+656.252873608" watchObservedRunningTime="2026-07-16 13:51:32.254564583 +0000 UTC m=+656.253596460"
Jul 16 13:51:34.558367 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:34.558329    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:34.558747 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:34.558398    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:34.571542 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:34.571516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:35.259115 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:35.259084    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk"
Jul 16 13:51:41.155573 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:41.155539    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:41.155946 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:41.155601    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:41.167854 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:41.167827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:51:41.286382 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:51:41.286353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-55mxl"
Jul 16 13:52:20.447684 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.447653    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"]
Jul 16 13:52:20.451151 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.451132    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.455069 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.455042    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 16 13:52:20.463645 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.463622    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"]
Jul 16 13:52:20.606413 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzkt4\" (UniqueName: \"kubernetes.io/projected/5bba1fb1-7bec-4800-9c88-dfb16e901697-kube-api-access-zzkt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.606640 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606433    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.606640 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.606640 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606587    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.606640 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bba1fb1-7bec-4800-9c88-dfb16e901697-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.606859 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.606658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707647 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707892 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bba1fb1-7bec-4800-9c88-dfb16e901697-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707892 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.707892 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707743    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzkt4\" (UniqueName: \"kubernetes.io/projected/5bba1fb1-7bec-4800-9c88-dfb16e901697-kube-api-access-zzkt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.708038 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.707968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.708038 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.708016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.708174 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.708144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.710072 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.710055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bba1fb1-7bec-4800-9c88-dfb16e901697-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.710204 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.710189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bba1fb1-7bec-4800-9c88-dfb16e901697-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.717240 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.717221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzkt4\" (UniqueName: \"kubernetes.io/projected/5bba1fb1-7bec-4800-9c88-dfb16e901697-kube-api-access-zzkt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-snl4p\" (UID: \"5bba1fb1-7bec-4800-9c88-dfb16e901697\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.761390 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.761352    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:20.895112 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:20.895086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"]
Jul 16 13:52:20.896158 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:52:20.896138    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bba1fb1_7bec_4800_9c88_dfb16e901697.slice/crio-5abb30f049a67082a81b137ab01203f1e42b41a4c092a198d9454c1336b48a1a WatchSource:0}: Error finding container 5abb30f049a67082a81b137ab01203f1e42b41a4c092a198d9454c1336b48a1a: Status 404 returned error can't find the container with id 5abb30f049a67082a81b137ab01203f1e42b41a4c092a198d9454c1336b48a1a
Jul 16 13:52:21.452971 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:21.452892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p" event={"ID":"5bba1fb1-7bec-4800-9c88-dfb16e901697","Type":"ContainerStarted","Data":"13613e546dd19573043ad07ec60fff7c217ca39669c1c8a4da98eefbf9872bbd"}
Jul 16 13:52:21.452971 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:21.452947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p" event={"ID":"5bba1fb1-7bec-4800-9c88-dfb16e901697","Type":"ContainerStarted","Data":"5abb30f049a67082a81b137ab01203f1e42b41a4c092a198d9454c1336b48a1a"}
Jul 16 13:52:21.484568 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:21.484526    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p" podStartSLOduration=1.272876762 podStartE2EDuration="1.484509955s" totalImagesPullingTime="211.633193ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:52:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:52:21.484445733 +0000 UTC m=+705.483477609" watchObservedRunningTime="2026-07-16 13:52:21.484509955 +0000 UTC m=+705.483541823"
Jul 16 13:52:30.762321 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:30.762240    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:30.762321 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:30.762304    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:30.774909 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:30.774886    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:52:31.509760 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:52:31.509732    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-snl4p"
Jul 16 13:55:27.987859 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:27.987826    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:55:27.988347 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:27.988054    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-97689c86b-8rkmj" podUID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" containerName="manager" containerID="cri-o://2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687" gracePeriod=30
Jul 16 13:55:28.234788 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.234763    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:55:28.290975 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.290852    2558 generic.go:356] "Generic (PLEG): container finished" podID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" containerID="2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687" exitCode=0
Jul 16 13:55:28.290975 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.290901    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-8rkmj"
Jul 16 13:55:28.290975 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.290937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-8rkmj" event={"ID":"0d414f5f-cab1-4a78-a1be-773b671cbbb6","Type":"ContainerDied","Data":"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"}
Jul 16 13:55:28.291224 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.291002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-8rkmj" event={"ID":"0d414f5f-cab1-4a78-a1be-773b671cbbb6","Type":"ContainerDied","Data":"a56b131fff8dd1e8c1302c419593b6f7fb206b704ad7cc8263189cba7e9608a5"}
Jul 16 13:55:28.291224 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.291034    2558 scope.go:117] "RemoveContainer" containerID="2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"
Jul 16 13:55:28.301536 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.301516    2558 scope.go:117] "RemoveContainer" containerID="2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"
Jul 16 13:55:28.301782 ip-10-0-137-62 kubenswrapper[2558]: E0716 13:55:28.301763    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687\": container with ID starting with 2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687 not found: ID does not exist" containerID="2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"
Jul 16 13:55:28.301849 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.301790    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687"} err="failed to get container status \"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687\": rpc error: code = NotFound desc = could not find container \"2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687\": container with ID starting with 2ffe372ac5fec05b7f315a0a8b875d2dd043661756da9f3ecf3af036dcb56687 not found: ID does not exist"
Jul 16 13:55:28.380370 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.380344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert\") pod \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") "
Jul 16 13:55:28.380578 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.380449    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjwsq\" (UniqueName: \"kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq\") pod \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\" (UID: \"0d414f5f-cab1-4a78-a1be-773b671cbbb6\") "
Jul 16 13:55:28.382440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.382406    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0d414f5f-cab1-4a78-a1be-773b671cbbb6" (UID: "0d414f5f-cab1-4a78-a1be-773b671cbbb6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 13:55:28.382440 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.382427    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq" (OuterVolumeSpecName: "kube-api-access-rjwsq") pod "0d414f5f-cab1-4a78-a1be-773b671cbbb6" (UID: "0d414f5f-cab1-4a78-a1be-773b671cbbb6"). InnerVolumeSpecName "kube-api-access-rjwsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 13:55:28.481291 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.481256    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjwsq\" (UniqueName: \"kubernetes.io/projected/0d414f5f-cab1-4a78-a1be-773b671cbbb6-kube-api-access-rjwsq\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:55:28.481291 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.481285    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d414f5f-cab1-4a78-a1be-773b671cbbb6-webhook-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 13:55:28.611677 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.611650    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:55:28.614646 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:28.614619    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-97689c86b-8rkmj"]
Jul 16 13:55:29.504679 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.504645    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-97689c86b-z6v46"]
Jul 16 13:55:29.505086 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.505011    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" containerName="manager"
Jul 16 13:55:29.505086 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.505022    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" containerName="manager"
Jul 16 13:55:29.505086 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.505075    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" containerName="manager"
Jul 16 13:55:29.509267 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.509250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.514466 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.514442    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhdtv\""
Jul 16 13:55:29.514624 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.514446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 13:55:29.514624 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.514501    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 13:55:29.519229 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.519209    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97689c86b-z6v46"]
Jul 16 13:55:29.590357 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.590319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7qgv\" (UniqueName: \"kubernetes.io/projected/18671c3c-e20f-486c-9bfa-656d52378fb8-kube-api-access-x7qgv\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.590357 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.590354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18671c3c-e20f-486c-9bfa-656d52378fb8-webhook-cert\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.691635 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.691592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7qgv\" (UniqueName: \"kubernetes.io/projected/18671c3c-e20f-486c-9bfa-656d52378fb8-kube-api-access-x7qgv\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.691635 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.691637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18671c3c-e20f-486c-9bfa-656d52378fb8-webhook-cert\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.694120 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.694095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18671c3c-e20f-486c-9bfa-656d52378fb8-webhook-cert\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.700515 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.700478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7qgv\" (UniqueName: \"kubernetes.io/projected/18671c3c-e20f-486c-9bfa-656d52378fb8-kube-api-access-x7qgv\") pod \"maas-controller-97689c86b-z6v46\" (UID: \"18671c3c-e20f-486c-9bfa-656d52378fb8\") " pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.819376 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.819346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:29.952136 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:29.952081    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-97689c86b-z6v46"]
Jul 16 13:55:29.954327 ip-10-0-137-62 kubenswrapper[2558]: W0716 13:55:29.954301    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18671c3c_e20f_486c_9bfa_656d52378fb8.slice/crio-00696df3ddcbc0c4361abec6e30656d844c4690fe193cd6f10fa1ea40181e2ce WatchSource:0}: Error finding container 00696df3ddcbc0c4361abec6e30656d844c4690fe193cd6f10fa1ea40181e2ce: Status 404 returned error can't find the container with id 00696df3ddcbc0c4361abec6e30656d844c4690fe193cd6f10fa1ea40181e2ce
Jul 16 13:55:30.302556 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:30.302451    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-z6v46" event={"ID":"18671c3c-e20f-486c-9bfa-656d52378fb8","Type":"ContainerStarted","Data":"00696df3ddcbc0c4361abec6e30656d844c4690fe193cd6f10fa1ea40181e2ce"}
Jul 16 13:55:30.508918 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:30.508891    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d414f5f-cab1-4a78-a1be-773b671cbbb6" path="/var/lib/kubelet/pods/0d414f5f-cab1-4a78-a1be-773b671cbbb6/volumes"
Jul 16 13:55:31.308225 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:31.308180    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-97689c86b-z6v46" event={"ID":"18671c3c-e20f-486c-9bfa-656d52378fb8","Type":"ContainerStarted","Data":"8b57731bc829d4fa40a044e88b4f8d3f7dd9d72f0cee954944a8f10c70d9dddb"}
Jul 16 13:55:31.308410 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:31.308317    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:36.373519 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:36.373473    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:55:36.374043 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:36.373833    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 13:55:36.377890 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:36.377864    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:55:36.378845 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:36.378822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 13:55:42.315214 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:42.315185    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-97689c86b-z6v46"
Jul 16 13:55:42.340800 ip-10-0-137-62 kubenswrapper[2558]: I0716 13:55:42.340734    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-97689c86b-z6v46" podStartSLOduration=12.82100117 podStartE2EDuration="13.340719461s" totalImagesPullingTime="519.718291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 13:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 13:55:31.339784321 +0000 UTC m=+895.338816197" watchObservedRunningTime="2026-07-16 13:55:42.340719461 +0000 UTC m=+906.339751374"
Jul 16 14:00:00.136504 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.136418    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"]
Jul 16 14:00:00.139776 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.139760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"
Jul 16 14:00:00.142200 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.142183    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s5bk8\""
Jul 16 14:00:00.148991 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.148965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"
Jul 16 14:00:00.156746 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.156724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"]
Jul 16 14:00:00.278417 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.278395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"]
Jul 16 14:00:00.280203 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:00:00.280172    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c4192c_c17e_4f6d_ab29_0aadc6d7f969.slice/crio-ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b WatchSource:0}: Error finding container ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b: Status 404 returned error can't find the container with id ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b
Jul 16 14:00:00.282037 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.282017    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 14:00:00.500046 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:00.499961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs" event={"ID":"66c4192c-c17e-4f6d-ab29-0aadc6d7f969","Type":"ContainerStarted","Data":"ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b"}
Jul 16 14:00:27.621840 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:27.621804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs" event={"ID":"66c4192c-c17e-4f6d-ab29-0aadc6d7f969","Type":"ContainerStarted","Data":"040a93feb36cd6b4a005e5f879553a9f4acc5e16a14ebd1e92e5e3aa56e85106"}
Jul 16 14:00:27.639229 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:27.639180    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs" podStartSLOduration=0.671109038 podStartE2EDuration="27.639163398s" totalImagesPullingTime="26.96805436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:00:27.637809965 +0000 UTC m=+1191.636841842" watchObservedRunningTime="2026-07-16 14:00:27.639163398 +0000 UTC m=+1191.638195272"
Jul 16 14:00:28.627770 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:28.627736    2558 generic.go:356] "Generic (PLEG): container finished" podID="66c4192c-c17e-4f6d-ab29-0aadc6d7f969" containerID="040a93feb36cd6b4a005e5f879553a9f4acc5e16a14ebd1e92e5e3aa56e85106" exitCode=0
Jul 16 14:00:28.628128 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:28.627781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs" event={"ID":"66c4192c-c17e-4f6d-ab29-0aadc6d7f969","Type":"ContainerDied","Data":"040a93feb36cd6b4a005e5f879553a9f4acc5e16a14ebd1e92e5e3aa56e85106"}
Jul 16 14:00:29.759321 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:29.759295    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"
Jul 16 14:00:30.638560 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:30.638515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs" event={"ID":"66c4192c-c17e-4f6d-ab29-0aadc6d7f969","Type":"ContainerDied","Data":"ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b"}
Jul 16 14:00:30.638560 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:30.638544    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736840-gmbzs"
Jul 16 14:00:30.638806 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:30.638581    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab79006b93de5996b31cd0577dded14d288657e7d91ad150c4e0cd5e4fdcda8b"
Jul 16 14:00:36.410848 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:36.410819    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:00:36.411414 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:36.410979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:00:36.413743 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:36.413724    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:00:36.413743 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:00:36.413732    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:05:36.437708 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:05:36.437681    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:05:36.438692 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:05:36.438670    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:05:36.440598 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:05:36.440578    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:05:36.441852 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:05:36.441833    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:07:56.553570 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.553357    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:07:56.554173 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.554155    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66c4192c-c17e-4f6d-ab29-0aadc6d7f969" containerName="cleanup"
Jul 16 14:07:56.554216 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.554177    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="66c4192c-c17e-4f6d-ab29-0aadc6d7f969" containerName="cleanup"
Jul 16 14:07:56.554293 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.554282    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="66c4192c-c17e-4f6d-ab29-0aadc6d7f969" containerName="cleanup"
Jul 16 14:07:56.557645 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.557620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.560456 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.560441    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-66781e21-openshift-default-dockercfg-gbbwn\""
Jul 16 14:07:56.576356 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.576333    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:07:56.617404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfv5t\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617545    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617559 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.617774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.617624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.718886 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.718845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.718901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.718931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.718954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfv5t\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.718998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719026    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719067 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719354 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719354 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719461 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719587 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719587 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.719714 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.719672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.720065 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.720040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.721428 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.721405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.721576 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.721447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.733097 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.733077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.733283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.733267    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfv5t\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t\") pod \"e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") " pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.760250 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.760220    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"]
Jul 16 14:07:56.765349 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.765331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.767976 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.767955    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-66781e21-serving-cert\""
Jul 16 14:07:56.768093 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.767981    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-q7jph\""
Jul 16 14:07:56.773163 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.773066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"]
Jul 16 14:07:56.820474 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.820406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9mt\" (UniqueName: \"kubernetes.io/projected/a58f9fb5-af9a-446d-bcfa-13e498f062da-kube-api-access-ht9mt\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.820474 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.820471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58f9fb5-af9a-446d-bcfa-13e498f062da-openshift-service-ca\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.820665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.820527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58f9fb5-af9a-446d-bcfa-13e498f062da-maas-api-tls\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.870601 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.870566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:56.921439 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.921402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58f9fb5-af9a-446d-bcfa-13e498f062da-openshift-service-ca\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.921646 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.921458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58f9fb5-af9a-446d-bcfa-13e498f062da-maas-api-tls\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.921646 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.921573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9mt\" (UniqueName: \"kubernetes.io/projected/a58f9fb5-af9a-446d-bcfa-13e498f062da-kube-api-access-ht9mt\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.922464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.922314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a58f9fb5-af9a-446d-bcfa-13e498f062da-openshift-service-ca\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.924461 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.924426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a58f9fb5-af9a-446d-bcfa-13e498f062da-maas-api-tls\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:56.930820 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:56.930793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9mt\" (UniqueName: \"kubernetes.io/projected/a58f9fb5-af9a-446d-bcfa-13e498f062da-kube-api-access-ht9mt\") pod \"maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj\" (UID: \"a58f9fb5-af9a-446d-bcfa-13e498f062da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:57.009362 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.009329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:07:57.012246 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:07:57.012218    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2995b9_a39c_4c23_9a61_ce53f0160093.slice/crio-ee91487cd9fb87a74ff26b0185e2bbad6a4dbba99109be2f0787c687d77ead70 WatchSource:0}: Error finding container ee91487cd9fb87a74ff26b0185e2bbad6a4dbba99109be2f0787c687d77ead70: Status 404 returned error can't find the container with id ee91487cd9fb87a74ff26b0185e2bbad6a4dbba99109be2f0787c687d77ead70
Jul 16 14:07:57.014253 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.014223    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:07:57.014345 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.014301    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:07:57.014403 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.014343    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:07:57.078464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.078447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:57.220669 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.220642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"]
Jul 16 14:07:57.222917 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:07:57.222869    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda58f9fb5_af9a_446d_bcfa_13e498f062da.slice/crio-d59a3ace70ab23946934ebe4875881f3d326dc0be5ee82203cc817f4dcf119f6 WatchSource:0}: Error finding container d59a3ace70ab23946934ebe4875881f3d326dc0be5ee82203cc817f4dcf119f6: Status 404 returned error can't find the container with id d59a3ace70ab23946934ebe4875881f3d326dc0be5ee82203cc817f4dcf119f6
Jul 16 14:07:57.224527 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.224509    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 14:07:57.617565 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.617522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" event={"ID":"1e2995b9-a39c-4c23-9a61-ce53f0160093","Type":"ContainerStarted","Data":"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"}
Jul 16 14:07:57.618036 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.617591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" event={"ID":"1e2995b9-a39c-4c23-9a61-ce53f0160093","Type":"ContainerStarted","Data":"ee91487cd9fb87a74ff26b0185e2bbad6a4dbba99109be2f0787c687d77ead70"}
Jul 16 14:07:57.618933 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.618903    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj" event={"ID":"a58f9fb5-af9a-446d-bcfa-13e498f062da","Type":"ContainerStarted","Data":"d59a3ace70ab23946934ebe4875881f3d326dc0be5ee82203cc817f4dcf119f6"}
Jul 16 14:07:57.640480 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.640441    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" podStartSLOduration=1.640424594 podStartE2EDuration="1.640424594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:07:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:07:57.638646027 +0000 UTC m=+1641.637677932" watchObservedRunningTime="2026-07-16 14:07:57.640424594 +0000 UTC m=+1641.639456522"
Jul 16 14:07:57.871447 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:57.871364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:58.625643 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:58.625566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj" event={"ID":"a58f9fb5-af9a-446d-bcfa-13e498f062da","Type":"ContainerStarted","Data":"87609c9a826edf9e494ed9e09b798066692bdbbcd9dd7a065221d5440ceea4cf"}
Jul 16 14:07:58.626033 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:58.625945    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:07:58.643241 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:58.643186    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj" podStartSLOduration=2.245463213 podStartE2EDuration="2.643169364s" totalImagesPullingTime="397.706151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:07:58.642933546 +0000 UTC m=+1642.641965423" watchObservedRunningTime="2026-07-16 14:07:58.643169364 +0000 UTC m=+1642.642201280"
Jul 16 14:07:58.876072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:58.875990    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:59.631205 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:59.631171    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:07:59.632025 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:07:59.632007    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:08:03.012562 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:03.012529    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:08:03.013063 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:03.012701    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" podUID="1e2995b9-a39c-4c23-9a61-ce53f0160093" containerName="istio-proxy" containerID="cri-o://bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86" gracePeriod=30
Jul 16 14:08:04.637364 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:04.637335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj"
Jul 16 14:08:08.560063 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.560033    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:08:08.637781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637701    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.637781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.637781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637766    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638050 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637796    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638050 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637935    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638050 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.637980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638204 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638053    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638204 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638116    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638204 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638160    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfv5t\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t\") pod \"1e2995b9-a39c-4c23-9a61-ce53f0160093\" (UID: \"1e2995b9-a39c-4c23-9a61-ce53f0160093\") "
Jul 16 14:08:08.638380 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:08.638533 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638475    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:08:08.638610 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638536    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.638662 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638624    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:08.638744 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638719    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:08.638798 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.638784    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:08.640571 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.640541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:08.640890 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.640599    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:08:08.640890 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.640628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:08.640890 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.640628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t" (OuterVolumeSpecName: "kube-api-access-kfv5t") pod "1e2995b9-a39c-4c23-9a61-ce53f0160093" (UID: "1e2995b9-a39c-4c23-9a61-ce53f0160093"). InnerVolumeSpecName "kube-api-access-kfv5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:08.676873 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.676841    2558 generic.go:356] "Generic (PLEG): container finished" podID="1e2995b9-a39c-4c23-9a61-ce53f0160093" containerID="bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86" exitCode=0
Jul 16 14:08:08.676976 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.676882    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"
Jul 16 14:08:08.676976 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.676926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" event={"ID":"1e2995b9-a39c-4c23-9a61-ce53f0160093","Type":"ContainerDied","Data":"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"}
Jul 16 14:08:08.677077 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.676982    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w" event={"ID":"1e2995b9-a39c-4c23-9a61-ce53f0160093","Type":"ContainerDied","Data":"ee91487cd9fb87a74ff26b0185e2bbad6a4dbba99109be2f0787c687d77ead70"}
Jul 16 14:08:08.677077 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.677006    2558 scope.go:117] "RemoveContainer" containerID="bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"
Jul 16 14:08:08.686138 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.686122    2558 scope.go:117] "RemoveContainer" containerID="bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"
Jul 16 14:08:08.686374 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:08:08.686356    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86\": container with ID starting with bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86 not found: ID does not exist" containerID="bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"
Jul 16 14:08:08.686420 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.686380    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86"} err="failed to get container status \"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86\": rpc error: code = NotFound desc = could not find container \"bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86\": container with ID starting with bb709973f0c6ca00bea784eb15a29ffdf8c5a5e1341938de6a7af6e24c501c86 not found: ID does not exist"
Jul 16 14:08:08.707573 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.707544    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:08:08.717191 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.717164    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-66781e21-openshift-default-6b8dc57df5-brx6w"]
Jul 16 14:08:08.739761 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739734    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739761 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739756    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfv5t\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-kube-api-access-kfv5t\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739761 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739765    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739946 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739774    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739946 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739782    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739946 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739789    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739946 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739797    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e2995b9-a39c-4c23-9a61-ce53f0160093-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:08.739946 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:08.739805    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e2995b9-a39c-4c23-9a61-ce53f0160093-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:10.420255 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.420219    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:10.420643 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.420628    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2995b9-a39c-4c23-9a61-ce53f0160093" containerName="istio-proxy"
Jul 16 14:08:10.420692 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.420644    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2995b9-a39c-4c23-9a61-ce53f0160093" containerName="istio-proxy"
Jul 16 14:08:10.420725 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.420721    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2995b9-a39c-4c23-9a61-ce53f0160093" containerName="istio-proxy"
Jul 16 14:08:10.425150 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.425123    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.427789 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.427768    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8fabccd0-gw-openshift-default-dockercfg-f4pjl\""
Jul 16 14:08:10.439189 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.439160    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:10.514949 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.514907    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2995b9-a39c-4c23-9a61-ce53f0160093" path="/var/lib/kubelet/pods/1e2995b9-a39c-4c23-9a61-ce53f0160093/volumes"
Jul 16 14:08:10.557481 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557686 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557686 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557765 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557765 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557825 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557858 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557892 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.557892 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.557878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658574 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658574 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658922 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658842    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.658978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658944    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659130 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.658981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659130 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.659108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659235 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.659153    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659235 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.659207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659411 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.659390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.659475 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.659407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.661308 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.661276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.661476 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.661456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.671049 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.670993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.671799 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.671777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token\") pod \"e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") " pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.736255 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.736217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:10.749797 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.749772    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"]
Jul 16 14:08:10.753563 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.753522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.756276 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.756246    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8fabccd0-serving-cert\""
Jul 16 14:08:10.766281 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.766193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"]
Jul 16 14:08:10.860512 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.860449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2019b4c4-4dc0-4b0c-af83-3fc078204411-openshift-service-ca\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.860675 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.860577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2019b4c4-4dc0-4b0c-af83-3fc078204411-maas-api-tls\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.860675 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.860606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmpc\" (UniqueName: \"kubernetes.io/projected/2019b4c4-4dc0-4b0c-af83-3fc078204411-kube-api-access-jqmpc\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.885072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.885039    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:10.885731 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:08:10.885701    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c050cc_7686_43a6_a2c2_87a0b4606582.slice/crio-59afec19742846d92f7d883a6096ff8d9023191d3bca87f9bb25920d4877b41e WatchSource:0}: Error finding container 59afec19742846d92f7d883a6096ff8d9023191d3bca87f9bb25920d4877b41e: Status 404 returned error can't find the container with id 59afec19742846d92f7d883a6096ff8d9023191d3bca87f9bb25920d4877b41e
Jul 16 14:08:10.887948 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.887919    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:10.888024 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.887980    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:10.888024 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.888009    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:10.961763 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.961737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2019b4c4-4dc0-4b0c-af83-3fc078204411-openshift-service-ca\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.961906 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.961790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2019b4c4-4dc0-4b0c-af83-3fc078204411-maas-api-tls\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.961906 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.961821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmpc\" (UniqueName: \"kubernetes.io/projected/2019b4c4-4dc0-4b0c-af83-3fc078204411-kube-api-access-jqmpc\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.962615 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.962575    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2019b4c4-4dc0-4b0c-af83-3fc078204411-openshift-service-ca\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.964037 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.964016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2019b4c4-4dc0-4b0c-af83-3fc078204411-maas-api-tls\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:10.970193 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:10.970170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmpc\" (UniqueName: \"kubernetes.io/projected/2019b4c4-4dc0-4b0c-af83-3fc078204411-kube-api-access-jqmpc\") pod \"maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg\" (UID: \"2019b4c4-4dc0-4b0c-af83-3fc078204411\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:11.080376 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.080333    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:11.223359 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.223332    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"]
Jul 16 14:08:11.224577 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:08:11.224552    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2019b4c4_4dc0_4b0c_af83_3fc078204411.slice/crio-76d6214f0f7d8caea640decec003c1b9ff806a10076b9d1b63ff0746b2aa68f4 WatchSource:0}: Error finding container 76d6214f0f7d8caea640decec003c1b9ff806a10076b9d1b63ff0746b2aa68f4: Status 404 returned error can't find the container with id 76d6214f0f7d8caea640decec003c1b9ff806a10076b9d1b63ff0746b2aa68f4
Jul 16 14:08:11.693917 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.693826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg" event={"ID":"2019b4c4-4dc0-4b0c-af83-3fc078204411","Type":"ContainerStarted","Data":"517c7964b9987465e1e09360a75aa1e0c54734daf43518bc8e470ef457dc6b29"}
Jul 16 14:08:11.693917 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.693900    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg" event={"ID":"2019b4c4-4dc0-4b0c-af83-3fc078204411","Type":"ContainerStarted","Data":"76d6214f0f7d8caea640decec003c1b9ff806a10076b9d1b63ff0746b2aa68f4"}
Jul 16 14:08:11.694391 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.693933    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:11.695566 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.695536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" event={"ID":"b9c050cc-7686-43a6-a2c2-87a0b4606582","Type":"ContainerStarted","Data":"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"}
Jul 16 14:08:11.695686 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.695588    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" event={"ID":"b9c050cc-7686-43a6-a2c2-87a0b4606582","Type":"ContainerStarted","Data":"59afec19742846d92f7d883a6096ff8d9023191d3bca87f9bb25920d4877b41e"}
Jul 16 14:08:11.715370 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.715318    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg" podStartSLOduration=1.398506064 podStartE2EDuration="1.715299895s" totalImagesPullingTime="316.793831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:08:11.711913328 +0000 UTC m=+1655.710945205" watchObservedRunningTime="2026-07-16 14:08:11.715299895 +0000 UTC m=+1655.714331773"
Jul 16 14:08:11.735506 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.735437    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" podStartSLOduration=1.735423618 podStartE2EDuration="1.735423618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:08:11.734835765 +0000 UTC m=+1655.733867668" watchObservedRunningTime="2026-07-16 14:08:11.735423618 +0000 UTC m=+1655.734455497"
Jul 16 14:08:11.736647 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.736624    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:11.741440 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:11.741417    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:12.700232 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:12.700197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:12.701036 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:12.701019    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:16.380646 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:16.380606    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:16.381219 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:16.380819    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" podUID="b9c050cc-7686-43a6-a2c2-87a0b4606582" containerName="istio-proxy" containerID="cri-o://f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e" gracePeriod=30
Jul 16 14:08:17.706264 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:17.706232    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg"
Jul 16 14:08:21.623169 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.623146    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:21.747653 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.747575    2558 generic.go:356] "Generic (PLEG): container finished" podID="b9c050cc-7686-43a6-a2c2-87a0b4606582" containerID="f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e" exitCode=0
Jul 16 14:08:21.747653 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.747617    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"
Jul 16 14:08:21.747839 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.747620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" event={"ID":"b9c050cc-7686-43a6-a2c2-87a0b4606582","Type":"ContainerDied","Data":"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"}
Jul 16 14:08:21.747839 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.747720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth" event={"ID":"b9c050cc-7686-43a6-a2c2-87a0b4606582","Type":"ContainerDied","Data":"59afec19742846d92f7d883a6096ff8d9023191d3bca87f9bb25920d4877b41e"}
Jul 16 14:08:21.747839 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.747741    2558 scope.go:117] "RemoveContainer" containerID="f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"
Jul 16 14:08:21.756241 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.756226    2558 scope.go:117] "RemoveContainer" containerID="f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"
Jul 16 14:08:21.756577 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:08:21.756471    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e\": container with ID starting with f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e not found: ID does not exist" containerID="f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"
Jul 16 14:08:21.756577 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.756517    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e"} err="failed to get container status \"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e\": rpc error: code = NotFound desc = could not find container \"f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e\": container with ID starting with f8234a096002771635306c16b134d86a98da3594a1c5af27569e0149e577b06e not found: ID does not exist"
Jul 16 14:08:21.764778 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764755    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764839 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764815    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764874 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764837    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764874 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764852    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764874 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764868    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764991 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764888    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.764991 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764915    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.765091 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.764990    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.765091 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765016    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:21.765091 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765060    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token\") pod \"b9c050cc-7686-43a6-a2c2-87a0b4606582\" (UID: \"b9c050cc-7686-43a6-a2c2-87a0b4606582\") "
Jul 16 14:08:21.765091 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765083    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:21.765283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:21.765352 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765331    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:08:21.765463 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765399    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.765463 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765423    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.765463 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.765438    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.766154 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.766134    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:21.767178 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.767149    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:08:21.767556 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.767529    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:21.767556 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.767549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r" (OuterVolumeSpecName: "kube-api-access-hfl2r") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "kube-api-access-hfl2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:21.767682 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.767592    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9c050cc-7686-43a6-a2c2-87a0b4606582" (UID: "b9c050cc-7686-43a6-a2c2-87a0b4606582"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:21.866384 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866347    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-kube-api-access-hfl2r\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.866384 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866379    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.866384 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866390    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.866384 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866398    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.866662 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866406    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9c050cc-7686-43a6-a2c2-87a0b4606582-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:21.866662 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:21.866413    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9c050cc-7686-43a6-a2c2-87a0b4606582-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:22.075954 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.075922    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:22.080334 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.080310    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8fabccd0-gw-openshift-default-d6b7f777f-klnth"]
Jul 16 14:08:22.509012 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.508979    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c050cc-7686-43a6-a2c2-87a0b4606582" path="/var/lib/kubelet/pods/b9c050cc-7686-43a6-a2c2-87a0b4606582/volumes"
Jul 16 14:08:22.762500 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.762383    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:22.762907 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.762887    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c050cc-7686-43a6-a2c2-87a0b4606582" containerName="istio-proxy"
Jul 16 14:08:22.762975 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.762910    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c050cc-7686-43a6-a2c2-87a0b4606582" containerName="istio-proxy"
Jul 16 14:08:22.763031 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.763022    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c050cc-7686-43a6-a2c2-87a0b4606582" containerName="istio-proxy"
Jul 16 14:08:22.766309 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.766284    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.768926 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.768902    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a7066c88-openshift-default-dockercfg-vmb6m\""
Jul 16 14:08:22.785171 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.785150    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:22.875333 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875476 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75bf\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875476 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875582 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875504    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875582 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875582 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875676 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875676 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.875739 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.875697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976610 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976649    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976706    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.976774 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977038 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977038 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977038 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.976892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75bf\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977038 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.977006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977236 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.977108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977236 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.977135    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977357 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.977332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.977566 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.977541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.979104 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.979085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.979391 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.979372    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.985804 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.985781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75bf\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:22.989898 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:22.989879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token\") pod \"e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") " pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:23.000957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.000933    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"]
Jul 16 14:08:23.005667 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.005648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.008142 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.008117    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-a7066c88-serving-cert\""
Jul 16 14:08:23.015066 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.014845    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"]
Jul 16 14:08:23.081239 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.081213    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:23.179112 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.179080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0373a862-e8aa-403e-8974-cabd64d0a931-openshift-service-ca\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.179255 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.179135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0373a862-e8aa-403e-8974-cabd64d0a931-maas-api-tls\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.179337 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.179313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw22r\" (UniqueName: \"kubernetes.io/projected/0373a862-e8aa-403e-8974-cabd64d0a931-kube-api-access-zw22r\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.222239 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.222214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:23.224224 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:08:23.224197    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e0d04fc_5e34_4c12_911c_988acf15d232.slice/crio-aa1ee4943a2c1aff5aa6a6a326f3073ca49f6d3ef8f8bc88878aa5ab414b0c8a WatchSource:0}: Error finding container aa1ee4943a2c1aff5aa6a6a326f3073ca49f6d3ef8f8bc88878aa5ab414b0c8a: Status 404 returned error can't find the container with id aa1ee4943a2c1aff5aa6a6a326f3073ca49f6d3ef8f8bc88878aa5ab414b0c8a
Jul 16 14:08:23.226386 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.226357    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:23.226469 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.226421    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:23.226469 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.226452    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:08:23.280725 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.280691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw22r\" (UniqueName: \"kubernetes.io/projected/0373a862-e8aa-403e-8974-cabd64d0a931-kube-api-access-zw22r\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.280840 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.280781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0373a862-e8aa-403e-8974-cabd64d0a931-openshift-service-ca\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.280840 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.280822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0373a862-e8aa-403e-8974-cabd64d0a931-maas-api-tls\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.281392 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.281368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0373a862-e8aa-403e-8974-cabd64d0a931-openshift-service-ca\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.283167 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.283148    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0373a862-e8aa-403e-8974-cabd64d0a931-maas-api-tls\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.288606 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.288587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw22r\" (UniqueName: \"kubernetes.io/projected/0373a862-e8aa-403e-8974-cabd64d0a931-kube-api-access-zw22r\") pod \"maas-api-e2e-derive-a7066c88-64864847fd-6drjr\" (UID: \"0373a862-e8aa-403e-8974-cabd64d0a931\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.319024 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.318998    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:23.453659 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.453627    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"]
Jul 16 14:08:23.456572 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:08:23.456544    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0373a862_e8aa_403e_8974_cabd64d0a931.slice/crio-057da7173998619f668b226d6ac1c08251926fcfab0dbc72c71773bdd012956c WatchSource:0}: Error finding container 057da7173998619f668b226d6ac1c08251926fcfab0dbc72c71773bdd012956c: Status 404 returned error can't find the container with id 057da7173998619f668b226d6ac1c08251926fcfab0dbc72c71773bdd012956c
Jul 16 14:08:23.759463 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.759426    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" event={"ID":"3e0d04fc-5e34-4c12-911c-988acf15d232","Type":"ContainerStarted","Data":"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"}
Jul 16 14:08:23.759664 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.759500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" event={"ID":"3e0d04fc-5e34-4c12-911c-988acf15d232","Type":"ContainerStarted","Data":"aa1ee4943a2c1aff5aa6a6a326f3073ca49f6d3ef8f8bc88878aa5ab414b0c8a"}
Jul 16 14:08:23.760609 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.760581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr" event={"ID":"0373a862-e8aa-403e-8974-cabd64d0a931","Type":"ContainerStarted","Data":"057da7173998619f668b226d6ac1c08251926fcfab0dbc72c71773bdd012956c"}
Jul 16 14:08:23.780994 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:23.780920    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" podStartSLOduration=1.780904532 podStartE2EDuration="1.780904532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:08:23.778860719 +0000 UTC m=+1667.777892595" watchObservedRunningTime="2026-07-16 14:08:23.780904532 +0000 UTC m=+1667.779936408"
Jul 16 14:08:24.081526 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.081477    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:24.086545 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.086518    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:24.767272 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.767232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr" event={"ID":"0373a862-e8aa-403e-8974-cabd64d0a931","Type":"ContainerStarted","Data":"80891456d75948cc30e1d3d622e9a258c57b7a07cfb5f48ec9e4605a84f04cd1"}
Jul 16 14:08:24.767456 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.767304    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:24.767611 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.767593    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:24.768506 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.768470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:24.787156 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:24.787112    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr" podStartSLOduration=2.434077251 podStartE2EDuration="2.787099983s" totalImagesPullingTime="353.022732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:08:24.784202033 +0000 UTC m=+1668.783233917" watchObservedRunningTime="2026-07-16 14:08:24.787099983 +0000 UTC m=+1668.786131859"
Jul 16 14:08:28.494873 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:28.494837    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:28.495649 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:28.495616    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" podUID="3e0d04fc-5e34-4c12-911c-988acf15d232" containerName="istio-proxy" containerID="cri-o://b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155" gracePeriod=30
Jul 16 14:08:30.794525 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:30.794474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-a7066c88-64864847fd-6drjr"
Jul 16 14:08:34.756820 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.756797    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:34.785142 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785077    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75bf\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785142 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785108    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785142 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785133    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785149    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785209    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785304    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785359    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785404 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785384    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs\") pod \"3e0d04fc-5e34-4c12-911c-988acf15d232\" (UID: \"3e0d04fc-5e34-4c12-911c-988acf15d232\") "
Jul 16 14:08:34.785789 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785432    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:34.785789 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785730    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.785984 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785913    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:34.785984 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.785923    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:34.786160 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.786039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:08:34.786160 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.786062    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:34.787475 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.787451    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:08:34.787581 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.787530    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf" (OuterVolumeSpecName: "kube-api-access-m75bf") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "kube-api-access-m75bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:34.787865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.787843    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:08:34.788210 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.788195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e0d04fc-5e34-4c12-911c-988acf15d232" (UID: "3e0d04fc-5e34-4c12-911c-988acf15d232"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:08:34.823071 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.823045    2558 generic.go:356] "Generic (PLEG): container finished" podID="3e0d04fc-5e34-4c12-911c-988acf15d232" containerID="b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155" exitCode=0
Jul 16 14:08:34.823192 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.823090    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"
Jul 16 14:08:34.823192 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.823133    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" event={"ID":"3e0d04fc-5e34-4c12-911c-988acf15d232","Type":"ContainerDied","Data":"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"}
Jul 16 14:08:34.823263 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.823184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg" event={"ID":"3e0d04fc-5e34-4c12-911c-988acf15d232","Type":"ContainerDied","Data":"aa1ee4943a2c1aff5aa6a6a326f3073ca49f6d3ef8f8bc88878aa5ab414b0c8a"}
Jul 16 14:08:34.823263 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.823226    2558 scope.go:117] "RemoveContainer" containerID="b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"
Jul 16 14:08:34.831806 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.831791    2558 scope.go:117] "RemoveContainer" containerID="b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"
Jul 16 14:08:34.832037 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:08:34.832019    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155\": container with ID starting with b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155 not found: ID does not exist" containerID="b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"
Jul 16 14:08:34.832096 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.832044    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155"} err="failed to get container status \"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155\": rpc error: code = NotFound desc = could not find container \"b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155\": container with ID starting with b434b7201b760edce0eb9195c3345c09f7d475be9c0ec3bcd77089e29dc2c155 not found: ID does not exist"
Jul 16 14:08:34.844334 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.844308    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:34.851628 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.851607    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a7066c88-openshift-default-59d44d6487-vwtqg"]
Jul 16 14:08:34.886455 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886425    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m75bf\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-kube-api-access-m75bf\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886455 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886453    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886465    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886472    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886480    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e0d04fc-5e34-4c12-911c-988acf15d232-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886504    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886518    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:34.886596 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:34.886530    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e0d04fc-5e34-4c12-911c-988acf15d232-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:08:36.510134 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:08:36.510085    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e0d04fc-5e34-4c12-911c-988acf15d232" path="/var/lib/kubelet/pods/3e0d04fc-5e34-4c12-911c-988acf15d232/volumes"
Jul 16 14:10:13.833984 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.833932    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"]
Jul 16 14:10:13.834982 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.834954    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e0d04fc-5e34-4c12-911c-988acf15d232" containerName="istio-proxy"
Jul 16 14:10:13.834982 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.834978    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e0d04fc-5e34-4c12-911c-988acf15d232" containerName="istio-proxy"
Jul 16 14:10:13.835212 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.835058    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e0d04fc-5e34-4c12-911c-988acf15d232" containerName="istio-proxy"
Jul 16 14:10:13.838745 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.838720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:13.839422 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.839397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"]
Jul 16 14:10:13.841480 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:13.841461    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-49f7930e-serving-cert\""
Jul 16 14:10:14.005182 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.005147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-maas-api-tls\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.005362 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.005196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-openshift-service-ca\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.005362 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.005273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zww\" (UniqueName: \"kubernetes.io/projected/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-kube-api-access-r5zww\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.106123 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.106040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-maas-api-tls\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.106123 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.106078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-openshift-service-ca\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.106123 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.106104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zww\" (UniqueName: \"kubernetes.io/projected/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-kube-api-access-r5zww\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.106780 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.106755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-openshift-service-ca\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.108419 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.108399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-maas-api-tls\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.114450 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.114425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zww\" (UniqueName: \"kubernetes.io/projected/1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95-kube-api-access-r5zww\") pod \"maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5\" (UID: \"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.150073 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.150044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:14.284318 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:14.284292    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"]
Jul 16 14:10:14.286203 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:10:14.286174    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9d9b50_dd86_4734_94b4_b1ce9f5d0b95.slice/crio-3c9d965d4e4c4b1dbb5d0e99781bae0afe60f81cdf96c8603010e4d6a450e907 WatchSource:0}: Error finding container 3c9d965d4e4c4b1dbb5d0e99781bae0afe60f81cdf96c8603010e4d6a450e907: Status 404 returned error can't find the container with id 3c9d965d4e4c4b1dbb5d0e99781bae0afe60f81cdf96c8603010e4d6a450e907
Jul 16 14:10:15.285669 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:15.285624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5" event={"ID":"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95","Type":"ContainerStarted","Data":"3c9d965d4e4c4b1dbb5d0e99781bae0afe60f81cdf96c8603010e4d6a450e907"}
Jul 16 14:10:16.292917 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:16.292839    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5" event={"ID":"1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95","Type":"ContainerStarted","Data":"78e821b9bd574d137c867a660b61b8cbd073776ee996be4f273ae1eadad9f26a"}
Jul 16 14:10:16.293350 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:16.292970    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:16.320007 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:16.319959    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5" podStartSLOduration=1.6966253569999998 podStartE2EDuration="3.319939028s" totalImagesPullingTime="1.623313671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:10:16.319060187 +0000 UTC m=+1780.318092098" watchObservedRunningTime="2026-07-16 14:10:16.319939028 +0000 UTC m=+1780.318970904"
Jul 16 14:10:22.303243 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:22.303216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5"
Jul 16 14:10:36.464991 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:36.464957    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:10:36.467093 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:36.467069    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:10:36.468003 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:36.467980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:10:36.470251 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:10:36.470232    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:11:52.346850 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.346818    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"]
Jul 16 14:11:52.350420 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.350404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.360201 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.360181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6cdc6b-serving-cert\""
Jul 16 14:11:52.373166 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.373139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"]
Jul 16 14:11:52.409984 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.409953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a024461-ba9c-47df-9634-333b79f29ef2-maas-api-tls\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.410127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.409994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9tbt\" (UniqueName: \"kubernetes.io/projected/7a024461-ba9c-47df-9634-333b79f29ef2-kube-api-access-s9tbt\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.410127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.410015    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a024461-ba9c-47df-9634-333b79f29ef2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.510884 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.510844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a024461-ba9c-47df-9634-333b79f29ef2-maas-api-tls\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.511081 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.510892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9tbt\" (UniqueName: \"kubernetes.io/projected/7a024461-ba9c-47df-9634-333b79f29ef2-kube-api-access-s9tbt\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.511081 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.510921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a024461-ba9c-47df-9634-333b79f29ef2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.511641 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.511620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a024461-ba9c-47df-9634-333b79f29ef2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.513322 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.513297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a024461-ba9c-47df-9634-333b79f29ef2-maas-api-tls\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.528379 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.528340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9tbt\" (UniqueName: \"kubernetes.io/projected/7a024461-ba9c-47df-9634-333b79f29ef2-kube-api-access-s9tbt\") pod \"maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q\" (UID: \"7a024461-ba9c-47df-9634-333b79f29ef2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.660743 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.660648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:52.805902 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:52.805830    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"]
Jul 16 14:11:52.808366 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:11:52.808343    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a024461_ba9c_47df_9634_333b79f29ef2.slice/crio-0da29c971a61f55400c79d124f852a99332375d5a5a490902de81eceef36e322 WatchSource:0}: Error finding container 0da29c971a61f55400c79d124f852a99332375d5a5a490902de81eceef36e322: Status 404 returned error can't find the container with id 0da29c971a61f55400c79d124f852a99332375d5a5a490902de81eceef36e322
Jul 16 14:11:53.739504 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:53.739458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q" event={"ID":"7a024461-ba9c-47df-9634-333b79f29ef2","Type":"ContainerStarted","Data":"e73a93e4580f323abcc6f8083f649f54fa51d4fcd6e436679cbe510ed7324bf9"}
Jul 16 14:11:53.739873 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:53.739536    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q" event={"ID":"7a024461-ba9c-47df-9634-333b79f29ef2","Type":"ContainerStarted","Data":"0da29c971a61f55400c79d124f852a99332375d5a5a490902de81eceef36e322"}
Jul 16 14:11:53.739873 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:53.739566    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:53.759991 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:53.759932    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q" podStartSLOduration=0.996144089 podStartE2EDuration="1.759913504s" totalImagesPullingTime="763.769415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:11:53.757395783 +0000 UTC m=+1877.756427658" watchObservedRunningTime="2026-07-16 14:11:53.759913504 +0000 UTC m=+1877.758945448"
Jul 16 14:11:58.415858 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.415777    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:11:58.419708 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.419687    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.423059 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.423036    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-84f3c8-openshift-default-dockercfg-j9mzm\""
Jul 16 14:11:58.436197 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.436169    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:11:58.467685 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.467848 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vlnb\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.467848 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.467848 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.467848 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.468072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.468072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.468072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.468072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.467982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569215 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569215 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569432    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vlnb\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.569793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.569636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.570081 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.570055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.570218 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.570102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.570218 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.570128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.570218 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.570162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.571805 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.571781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.572347 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.572327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.578459 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.578436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vlnb\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.578604 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.578587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token\") pod \"e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") " pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.730398 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.730308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:11:58.874755 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.874729    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:11:58.876135 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:11:58.876106    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d43b04e_9601_48e4_98d3_a515a975377f.slice/crio-74a1ce4a09177373ecad2214cb4d74ff4130874f54f9d7e526423b7b6fc8ea4e WatchSource:0}: Error finding container 74a1ce4a09177373ecad2214cb4d74ff4130874f54f9d7e526423b7b6fc8ea4e: Status 404 returned error can't find the container with id 74a1ce4a09177373ecad2214cb4d74ff4130874f54f9d7e526423b7b6fc8ea4e
Jul 16 14:11:58.878208 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.878178    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:11:58.878293 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.878237    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:11:58.878293 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:58.878273    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:11:59.751409 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:59.751380    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q"
Jul 16 14:11:59.772360 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:59.772322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerStarted","Data":"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"}
Jul 16 14:11:59.772580 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:59.772381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerStarted","Data":"74a1ce4a09177373ecad2214cb4d74ff4130874f54f9d7e526423b7b6fc8ea4e"}
Jul 16 14:11:59.796374 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:11:59.796315    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podStartSLOduration=1.796298836 podStartE2EDuration="1.796298836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:11:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:11:59.79429718 +0000 UTC m=+1883.793329103" watchObservedRunningTime="2026-07-16 14:11:59.796298836 +0000 UTC m=+1883.795330712"
Jul 16 14:12:00.730701 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:00.730667    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:00.736175 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:00.736149    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:00.777450 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:00.777410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:00.778265 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:00.778247    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:16.819665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:16.819622    2558 patch_prober.go:28] interesting pod/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 14:12:16.820072 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:16.819699    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 14:12:17.861881 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.861795    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d43b04e-9601-48e4-98d3-a515a975377f" containerID="9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042" exitCode=0
Jul 16 14:12:17.861881 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.861871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerDied","Data":"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"}
Jul 16 14:12:17.862369 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.862259    2558 scope.go:117] "RemoveContainer" containerID="9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"
Jul 16 14:12:17.863224 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.863200    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:12:17.863286 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.863265    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:12:17.863326 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:17.863295    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:12:18.870449 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:18.870407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerStarted","Data":"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"}
Jul 16 14:12:19.731151 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:19.731107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:19.731441 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:19.731417    2558 patch_prober.go:28] interesting pod/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 14:12:19.731533 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:19.731479    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 14:12:20.731054 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:20.731015    2558 patch_prober.go:28] interesting pod/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 14:12:20.731460 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:20.731074    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 14:12:21.731626 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:21.731585    2558 patch_prober.go:28] interesting pod/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 14:12:21.732015 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:21.731657    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 14:12:22.731190 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:22.731152    2558 patch_prober.go:28] interesting pod/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 14:12:22.731380 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:22.731224    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 14:12:23.734357 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:23.734329    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:23.734812 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:23.734742    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:12:23.735377 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:12:23.735358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:13:56.517736 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:13:56.517705    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:13:56.518192 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:13:56.517893    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy" containerID="cri-o://731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd" gracePeriod=30
Jul 16 14:14:01.780635 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.780571    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:14:01.846837 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.846803    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.846978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.846848    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.846978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.846890    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.846978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.846942    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.846978 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.846972    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.847148 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847002    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.847148 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.847148 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vlnb\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.847148 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs\") pod \"8d43b04e-9601-48e4-98d3-a515a975377f\" (UID: \"8d43b04e-9601-48e4-98d3-a515a975377f\") "
Jul 16 14:14:01.847512 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847379    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:01.847512 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847432    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:14:01.847512 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:01.847512 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847481    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.847807 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847738    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:01.847807 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.847783    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:01.849153 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.849124    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:14:01.849298 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.849281    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb" (OuterVolumeSpecName: "kube-api-access-9vlnb") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "kube-api-access-9vlnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:14:01.849436 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.849418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:14:01.849510 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.849417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d43b04e-9601-48e4-98d3-a515a975377f" (UID: "8d43b04e-9601-48e4-98d3-a515a975377f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:01.948885 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948855    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.948885 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948879    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vlnb\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-kube-api-access-9vlnb\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.948885 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948889    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.949101 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948897    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d43b04e-9601-48e4-98d3-a515a975377f-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.949101 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948904    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.949101 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948912    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d43b04e-9601-48e4-98d3-a515a975377f-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.949101 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948919    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d43b04e-9601-48e4-98d3-a515a975377f-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:01.949101 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:01.948927    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d43b04e-9601-48e4-98d3-a515a975377f-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:02.374304 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.374272    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d43b04e-9601-48e4-98d3-a515a975377f" containerID="731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd" exitCode=0
Jul 16 14:14:02.374468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.374315    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"
Jul 16 14:14:02.374468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.374352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerDied","Data":"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"}
Jul 16 14:14:02.374468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.374402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm" event={"ID":"8d43b04e-9601-48e4-98d3-a515a975377f","Type":"ContainerDied","Data":"74a1ce4a09177373ecad2214cb4d74ff4130874f54f9d7e526423b7b6fc8ea4e"}
Jul 16 14:14:02.374468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.374424    2558 scope.go:117] "RemoveContainer" containerID="731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"
Jul 16 14:14:02.385476 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.385414    2558 scope.go:117] "RemoveContainer" containerID="9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"
Jul 16 14:14:02.394061 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.394044    2558 scope.go:117] "RemoveContainer" containerID="731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"
Jul 16 14:14:02.394329 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:14:02.394311    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd\": container with ID starting with 731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd not found: ID does not exist" containerID="731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"
Jul 16 14:14:02.394396 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.394339    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd"} err="failed to get container status \"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd\": rpc error: code = NotFound desc = could not find container \"731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd\": container with ID starting with 731c1b7d8ec911d606dcacb6ef3e82890e3b771a0f2adca0aaf12e4a86516acd not found: ID does not exist"
Jul 16 14:14:02.394396 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.394360    2558 scope.go:117] "RemoveContainer" containerID="9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"
Jul 16 14:14:02.394610 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:14:02.394591    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042\": container with ID starting with 9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042 not found: ID does not exist" containerID="9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"
Jul 16 14:14:02.394672 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.394615    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042"} err="failed to get container status \"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042\": rpc error: code = NotFound desc = could not find container \"9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042\": container with ID starting with 9e5a4d1260a221199a5f515ec6c2cb61dab1c31d080a4ab1abb5aaa0d9f1c042 not found: ID does not exist"
Jul 16 14:14:02.403672 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.403649    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:14:02.410406 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.410386    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-84f3c8-openshift-default-7c7cd47ddc-xg4zm"]
Jul 16 14:14:02.510054 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:02.510026    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" path="/var/lib/kubelet/pods/8d43b04e-9601-48e4-98d3-a515a975377f/volumes"
Jul 16 14:14:06.215080 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.215046    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:06.215468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.215446    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:06.215468 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.215457    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:06.215592 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.215548    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:06.215592 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.215557    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:06.220090 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.220068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.222627 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.222607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bb5499-openshift-default-dockercfg-mh955\""
Jul 16 14:14:06.232299 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.232275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:06.290013 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.289979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290154 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290154 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290154 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290165    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcv7m\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290231    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290283 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.290461 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.290360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391688 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391832    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.391865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcv7m\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392126 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392126 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392126 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.391968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392126 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.392049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392350 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.392230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392350 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.392253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392479 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.392454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.392706 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.392687    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.394059 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.394040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.394196 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.394179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.404728 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.404701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.404837 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.404821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcv7m\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m\") pod \"e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") " pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.531402 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.531322    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:06.676915 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.676888    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:06.678555 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:14:06.678528    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c974e91_d5bc_4cbe_9a0b_d4dc68b3cad4.slice/crio-0bb67fbbe2be19dc3a7dcb831122371e2350e6a6b5a90281f7be722f894ac21c WatchSource:0}: Error finding container 0bb67fbbe2be19dc3a7dcb831122371e2350e6a6b5a90281f7be722f894ac21c: Status 404 returned error can't find the container with id 0bb67fbbe2be19dc3a7dcb831122371e2350e6a6b5a90281f7be722f894ac21c
Jul 16 14:14:06.680628 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.680598    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:06.680702 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.680659    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:06.680702 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:06.680691    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:07.406476 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:07.406445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerStarted","Data":"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"}
Jul 16 14:14:07.406918 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:07.406519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerStarted","Data":"0bb67fbbe2be19dc3a7dcb831122371e2350e6a6b5a90281f7be722f894ac21c"}
Jul 16 14:14:07.431660 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:07.431611    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podStartSLOduration=1.43159599 podStartE2EDuration="1.43159599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:14:07.42935329 +0000 UTC m=+2011.428385192" watchObservedRunningTime="2026-07-16 14:14:07.43159599 +0000 UTC m=+2011.430627928"
Jul 16 14:14:07.531662 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:07.531629    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:07.536707 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:07.536681    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:08.411461 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:08.411428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:08.412594 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:08.412571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:22.486870 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.486840    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerID="e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549" exitCode=0
Jul 16 14:14:22.487315 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.486912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerDied","Data":"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"}
Jul 16 14:14:22.487362 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.487334    2558 scope.go:117] "RemoveContainer" containerID="e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"
Jul 16 14:14:22.488403 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.488375    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:22.488535 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.488442    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:22.488535 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:22.488474    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:23.411360 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:23.411318    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:23.495236 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:23.495198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerStarted","Data":"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"}
Jul 16 14:14:23.532457 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:23.532422    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:23.533439 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:23.533406    2558 patch_prober.go:28] interesting pod/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 14:14:23.533579 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:23.533456    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 14:14:24.532344 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:24.532311    2558 patch_prober.go:28] interesting pod/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 14:14:24.532823 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:24.532365    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 14:14:25.532171 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:25.532134    2558 patch_prober.go:28] interesting pod/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 14:14:25.532350 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:25.532195    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 14:14:26.532007 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:26.531971    2558 patch_prober.go:28] interesting pod/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 14:14:26.532417 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:26.532023    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 14:14:27.532545 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:27.532512    2558 patch_prober.go:28] interesting pod/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 16 14:14:27.533017 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:27.532570    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 16 14:14:28.536168 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:28.536139    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:28.536640 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:28.536403    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:28.537129 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:28.537114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:47.756240 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:47.756205    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:47.756784 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:47.756432    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy" containerID="cri-o://d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf" gracePeriod=30
Jul 16 14:14:53.015554 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.015522    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:53.131700 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131659    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.131920 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131722    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.131920 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131767    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.131920 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131846    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.131920 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131877    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcv7m\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.132131 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131938    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.132131 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131964    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.132131 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.132131 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132051    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data\") pod \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\" (UID: \"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4\") "
Jul 16 14:14:53.132131 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.131987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:53.132379 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132099    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:53.132484 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132462    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.132565 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132515    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.132565 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132555    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:14:53.132667 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:53.132884 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.132863    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data" (OuterVolumeSpecName: "istio-data") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:53.134218 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.134189    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:14:53.134325 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.134216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m" (OuterVolumeSpecName: "kube-api-access-vcv7m") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "kube-api-access-vcv7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:14:53.134437 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.134418    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:14:53.134517 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.134505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" (UID: "5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:14:53.234127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234079    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234114    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcv7m\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-kube-api-access-vcv7m\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234125    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234134    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234712 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234142    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234712 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234150    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.234712 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.234157    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:14:53.636080 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.636046    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerID="d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf" exitCode=0
Jul 16 14:14:53.636249 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.636093    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerDied","Data":"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"}
Jul 16 14:14:53.636249 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.636100    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"
Jul 16 14:14:53.636249 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.636142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg" event={"ID":"5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4","Type":"ContainerDied","Data":"0bb67fbbe2be19dc3a7dcb831122371e2350e6a6b5a90281f7be722f894ac21c"}
Jul 16 14:14:53.636249 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.636166    2558 scope.go:117] "RemoveContainer" containerID="d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"
Jul 16 14:14:53.646828 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.646800    2558 scope.go:117] "RemoveContainer" containerID="e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"
Jul 16 14:14:53.655881 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.655861    2558 scope.go:117] "RemoveContainer" containerID="d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"
Jul 16 14:14:53.656183 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:14:53.656160    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf\": container with ID starting with d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf not found: ID does not exist" containerID="d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"
Jul 16 14:14:53.656233 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.656193    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf"} err="failed to get container status \"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf\": rpc error: code = NotFound desc = could not find container \"d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf\": container with ID starting with d8d71a0d86f28f6e0f81cdf9b2b6ec23622a420f593efa5591a89bb0ebd8dccf not found: ID does not exist"
Jul 16 14:14:53.656233 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.656212    2558 scope.go:117] "RemoveContainer" containerID="e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"
Jul 16 14:14:53.656464 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:14:53.656445    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549\": container with ID starting with e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549 not found: ID does not exist" containerID="e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"
Jul 16 14:14:53.656542 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.656470    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549"} err="failed to get container status \"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549\": rpc error: code = NotFound desc = could not find container \"e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549\": container with ID starting with e97155bf52a5a7df2aae23b8dcad0621f36c436bc6d7c24050704de327bac549 not found: ID does not exist"
Jul 16 14:14:53.664459 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.664431    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:53.668955 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:53.668931    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bb5499-openshift-default-56bf8d868c-dgxvg"]
Jul 16 14:14:54.510127 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:54.510086    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" path="/var/lib/kubelet/pods/5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4/volumes"
Jul 16 14:14:57.418220 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418189    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:14:57.418606 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418585    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:57.418606 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418597    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:57.418678 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418640    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:57.418678 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418647    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d43b04e-9601-48e4-98d3-a515a975377f" containerName="istio-proxy"
Jul 16 14:14:57.418742 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418700    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:57.418742 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.418708    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:57.423416 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.423398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.425968 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.425942    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1f53bd-openshift-default-dockercfg-n8smb\""
Jul 16 14:14:57.434922 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.434899    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:14:57.472160 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472324 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472173    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cl2m\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472324 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472324 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472324 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.472464 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.472430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573365 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573365 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573649 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573649 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573649 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573649 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cl2m\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.573865 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573821    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.574027 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.573885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.574240 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.574209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.574330 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.574295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.574538 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.574513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.574891 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.574869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.575872 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.575850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.576087 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.576070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.582922 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.582891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.583018 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.582944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cl2m\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m\") pod \"e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") " pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.734592 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.734478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:57.874451 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.874421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:14:57.876183 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:14:57.876153    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1ea4be_770a_4be6_8b9a_e350a19a7eb1.slice/crio-972ab82079904764a89ece131d15dfc8fd855b8e58a797181d485ddda56295f7 WatchSource:0}: Error finding container 972ab82079904764a89ece131d15dfc8fd855b8e58a797181d485ddda56295f7: Status 404 returned error can't find the container with id 972ab82079904764a89ece131d15dfc8fd855b8e58a797181d485ddda56295f7
Jul 16 14:14:57.878806 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.878773    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:57.878889 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.878844    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:57.878889 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:57.878876    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:14:58.662347 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.662268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerStarted","Data":"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"}
Jul 16 14:14:58.662347 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.662323    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerStarted","Data":"972ab82079904764a89ece131d15dfc8fd855b8e58a797181d485ddda56295f7"}
Jul 16 14:14:58.688455 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.688393    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podStartSLOduration=1.688360005 podStartE2EDuration="1.688360005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:14:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:14:58.686612808 +0000 UTC m=+2062.685644714" watchObservedRunningTime="2026-07-16 14:14:58.688360005 +0000 UTC m=+2062.687391884"
Jul 16 14:14:58.735505 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.735466    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:58.736947 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.736919    2558 patch_prober.go:28] interesting pod/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 14:14:58.737091 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:58.736969    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 14:14:59.738883 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.738852    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:14:59.742780 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.742754    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"]
Jul 16 14:14:59.743137 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.743125    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:59.743206 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.743138    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c974e91-d5bc-4cbe-9a0b-d4dc68b3cad4" containerName="istio-proxy"
Jul 16 14:14:59.746444 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.746426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.748840 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.748816    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1f53bd-serving-cert\""
Jul 16 14:14:59.759875 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.759851    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"]
Jul 16 14:14:59.795155 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.795112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8xjh\" (UniqueName: \"kubernetes.io/projected/10d04bc9-7a6e-46d2-bce6-384c99a36457-kube-api-access-p8xjh\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.795300 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.795201    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d04bc9-7a6e-46d2-bce6-384c99a36457-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.795300 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.795281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d04bc9-7a6e-46d2-bce6-384c99a36457-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.896013 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.895982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d04bc9-7a6e-46d2-bce6-384c99a36457-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.896205 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.896071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8xjh\" (UniqueName: \"kubernetes.io/projected/10d04bc9-7a6e-46d2-bce6-384c99a36457-kube-api-access-p8xjh\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.896205 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.896101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d04bc9-7a6e-46d2-bce6-384c99a36457-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.896780 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.896760    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10d04bc9-7a6e-46d2-bce6-384c99a36457-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.898438 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.898415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10d04bc9-7a6e-46d2-bce6-384c99a36457-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:14:59.905856 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:14:59.905823    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8xjh\" (UniqueName: \"kubernetes.io/projected/10d04bc9-7a6e-46d2-bce6-384c99a36457-kube-api-access-p8xjh\") pod \"maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8\" (UID: \"10d04bc9-7a6e-46d2-bce6-384c99a36457\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:15:00.057508 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.057460    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:15:00.222344 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.222307    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"]
Jul 16 14:15:00.227559 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:15:00.227529    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d04bc9_7a6e_46d2_bce6_384c99a36457.slice/crio-059c1cb949abe92a5d14c9c62a948a3d0ec4199236c8413251a5b22815720c4d WatchSource:0}: Error finding container 059c1cb949abe92a5d14c9c62a948a3d0ec4199236c8413251a5b22815720c4d: Status 404 returned error can't find the container with id 059c1cb949abe92a5d14c9c62a948a3d0ec4199236c8413251a5b22815720c4d
Jul 16 14:15:00.229414 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.229394    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 14:15:00.675001 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.674964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8" event={"ID":"10d04bc9-7a6e-46d2-bce6-384c99a36457","Type":"ContainerStarted","Data":"059c1cb949abe92a5d14c9c62a948a3d0ec4199236c8413251a5b22815720c4d"}
Jul 16 14:15:00.675197 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.675177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:00.676644 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:00.676625    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:01.681876 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:01.681776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8" event={"ID":"10d04bc9-7a6e-46d2-bce6-384c99a36457","Type":"ContainerStarted","Data":"6b1c25bd3132efdd3a74ba701fd734b43f71b19bfa2be4fe836d6234793d04c4"}
Jul 16 14:15:01.681876 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:01.681859    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:15:01.703919 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:01.703870    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8" podStartSLOduration=1.54082009 podStartE2EDuration="2.703851467s" totalImagesPullingTime="1.163031377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:15:01.70093 +0000 UTC m=+2065.699961877" watchObservedRunningTime="2026-07-16 14:15:01.703851467 +0000 UTC m=+2065.702883346"
Jul 16 14:15:07.691533 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:07.691478    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8"
Jul 16 14:15:20.780420 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.780391    2558 generic.go:356] "Generic (PLEG): container finished" podID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerID="4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9" exitCode=0
Jul 16 14:15:20.780800 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.780462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerDied","Data":"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"}
Jul 16 14:15:20.780896 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.780882    2558 scope.go:117] "RemoveContainer" containerID="4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"
Jul 16 14:15:20.781926 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.781903    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:15:20.781983 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.781964    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:15:20.782027 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:20.781998    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 16 14:15:21.791887 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:21.791805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerStarted","Data":"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"}
Jul 16 14:15:22.734665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:22.734633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:22.734840 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:22.734800    2558 patch_prober.go:28] interesting pod/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 14:15:22.734886 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:22.734849    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 14:15:23.735830 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:23.735796    2558 patch_prober.go:28] interesting pod/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 14:15:23.736215 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:23.735848    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 14:15:24.735766 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:24.735732    2558 patch_prober.go:28] interesting pod/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 14:15:24.735952 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:24.735785    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 14:15:25.735690 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:25.735652    2558 patch_prober.go:28] interesting pod/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 16 14:15:25.735875 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:25.735708    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 16 14:15:26.739674 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:26.739643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:26.740051 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:26.739983    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:26.740669 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:26.740648    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:15:36.494967 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:36.494937    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:15:36.497960 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:36.497936    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:15:36.498099 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:36.498044    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:15:36.501294 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:15:36.501274    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:20:36.535359 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:20:36.535330    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:20:36.537972 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:20:36.535442    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:20:36.538158 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:20:36.538144    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:20:36.538349 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:20:36.538334    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7fclh_3ba2d7a3-087b-4395-bec7-2b44def67046/ovn-acl-logging/0.log"
Jul 16 14:21:35.933314 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:35.933281    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:21:35.933872 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:35.933599    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy" containerID="cri-o://e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73" gracePeriod=30
Jul 16 14:21:41.195351 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.195325    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:21:41.224175 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224108    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224175 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224382 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224211    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224382 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224237    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224382 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224266    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cl2m\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224382 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224309    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224382 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224373    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224433    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token\") pod \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\" (UID: \"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1\") "
Jul 16 14:21:41.224665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224562    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 14:21:41.225727 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224840    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:21:41.225727 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224909    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istiod-ca-cert\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.225727 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.224986    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:21:41.225727 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.225222    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:21:41.225727 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.225677    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:21:41.227344 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.227314    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m" (OuterVolumeSpecName: "kube-api-access-8cl2m") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "kube-api-access-8cl2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:21:41.227445 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.227337    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 14:21:41.227445 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.227349    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 14:21:41.227544 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.227454    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" (UID: "4f1ea4be-770a-4be6-8b9a-e350a19a7eb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 14:21:41.325793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325741    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-data\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.325793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325774    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-certs\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.325793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325783    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-envoy\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.325793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325793    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cl2m\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-kube-api-access-8cl2m\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.325793 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325801    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-credential-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.326077 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325810    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-podinfo\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.326077 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325818    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-workload-socket\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.326077 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.325825    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1-istio-token\") on node \"ip-10-0-137-62.ec2.internal\" DevicePath \"\""
Jul 16 14:21:41.614955 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.614921    2558 generic.go:356] "Generic (PLEG): container finished" podID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerID="e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73" exitCode=0
Jul 16 14:21:41.615145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.614967    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"
Jul 16 14:21:41.615145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.615004    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerDied","Data":"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"}
Jul 16 14:21:41.615145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.615079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4" event={"ID":"4f1ea4be-770a-4be6-8b9a-e350a19a7eb1","Type":"ContainerDied","Data":"972ab82079904764a89ece131d15dfc8fd855b8e58a797181d485ddda56295f7"}
Jul 16 14:21:41.615145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.615104    2558 scope.go:117] "RemoveContainer" containerID="e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"
Jul 16 14:21:41.626621 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.626604    2558 scope.go:117] "RemoveContainer" containerID="4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"
Jul 16 14:21:41.634818 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.634802    2558 scope.go:117] "RemoveContainer" containerID="e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"
Jul 16 14:21:41.635065 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:21:41.635046    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73\": container with ID starting with e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73 not found: ID does not exist" containerID="e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"
Jul 16 14:21:41.635145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.635078    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73"} err="failed to get container status \"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73\": rpc error: code = NotFound desc = could not find container \"e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73\": container with ID starting with e0fe76cc97644387afa6537a7eff44d33e8d2b057d3120d2cb6ea17453a2ff73 not found: ID does not exist"
Jul 16 14:21:41.635145 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.635108    2558 scope.go:117] "RemoveContainer" containerID="4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"
Jul 16 14:21:41.635342 ip-10-0-137-62 kubenswrapper[2558]: E0716 14:21:41.635324    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9\": container with ID starting with 4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9 not found: ID does not exist" containerID="4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"
Jul 16 14:21:41.635383 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.635349    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9"} err="failed to get container status \"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9\": rpc error: code = NotFound desc = could not find container \"4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9\": container with ID starting with 4383fcfc2ad0eec6cefff9c7a55b61ebf775a6bd391de9a96de4fc87d73ecae9 not found: ID does not exist"
Jul 16 14:21:41.640032 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.640012    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:21:41.648937 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:41.648908    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1f53bd-openshift-default-577c78574c-zlcp4"]
Jul 16 14:21:42.509745 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:42.509708    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" path="/var/lib/kubelet/pods/4f1ea4be-770a-4be6-8b9a-e350a19a7eb1/volumes"
Jul 16 14:21:42.647081 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:42.647057    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z8qc2_edc0b624-bd3f-4826-b561-73c50db4e0a7/manager/0.log"
Jul 16 14:21:42.778190 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:42.778115    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hslsf_e7b6ef65-1204-4be7-b4c7-8ae098a17b53/manager/0.log"
Jul 16 14:21:42.918763 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:42.918734    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-97689c86b-z6v46_18671c3c-e20f-486c-9bfa-656d52378fb8/manager/0.log"
Jul 16 14:21:43.594591 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:43.594562    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558d6dc665-dlxps_be46a2eb-a276-4997-b90f-25b83426ce46/copy-manifests/0.log"
Jul 16 14:21:43.607514 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:43.607468    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558d6dc665-dlxps_be46a2eb-a276-4997-b90f-25b83426ce46/manager/0.log"
Jul 16 14:21:44.015242 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:44.015161    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-646c9c8cc7-r24l9_1d251193-4066-4f9d-973f-3b88b81af9f0/maas-api/0.log"
Jul 16 14:21:44.144223 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:44.144193    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-66781e21-66c46f4f54-wsjsj_a58f9fb5-af9a-446d-bcfa-13e498f062da/maas-api/0.log"
Jul 16 14:21:44.537665 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:44.537631    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-derive-a7066c88-64864847fd-6drjr_0373a862-e8aa-403e-8974-cabd64d0a931/maas-api/0.log"
Jul 16 14:21:44.668044 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:44.668015    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-6cdc6b-798b56b9cc-7g55q_7a024461-ba9c-47df-9634-333b79f29ef2/maas-api/0.log"
Jul 16 14:21:44.930465 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:44.930419    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-8fabccd0-dfb94798b-bj8xg_2019b4c4-4dc0-4b0c-af83-3fc078204411/maas-api/0.log"
Jul 16 14:21:45.064984 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:45.064952    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-mt-49f7930e-5cff74d5db-vh7z5_1d9d9b50-dd86-4734-94b4-b1ce9f5d0b95/maas-api/0.log"
Jul 16 14:21:45.323839 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:45.323812    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-1f53bd-94d7bb545-vb4r8_10d04bc9-7a6e-46d2-bce6-384c99a36457/maas-api/0.log"
Jul 16 14:21:45.445169 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:45.445140    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736840-gmbzs_66c4192c-c17e-4f6d-ab29-0aadc6d7f969/cleanup/0.log"
Jul 16 14:21:49.343551 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:49.343520    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8j8h_d5d0a908-b706-4ec7-9793-a02aba39dad2/manager/0.log"
Jul 16 14:21:49.733167 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:49.733086    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lnt87_d8d7fda0-3f20-4426-8026-1e4ed49c0e9d/istio-proxy/0.log"
Jul 16 14:21:50.401244 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:50.401212    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bwscm_79fd2a3f-5686-4159-90dc-ddfdffc093dd/payload-pre-processing/0.log"
Jul 16 14:21:51.051141 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:51.051111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-pm5gk_f3a8b629-610a-49ea-85c3-7609cff95e71/main/0.log"
Jul 16 14:21:51.301021 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:51.300991    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-55mxl_b711df3d-0615-4bdd-b381-4e5387e0f592/main/0.log"
Jul 16 14:21:51.554172 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:21:51.554134    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-snl4p_5bba1fb1-7bec-4800-9c88-dfb16e901697/main/0.log"
Jul 16 14:22:02.414817 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:02.414787    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4vfc_66c55ac9-cb12-429a-b72c-7ac948ed30a6/global-pull-secret-syncer/0.log"
Jul 16 14:22:02.591167 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:02.591136    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zb5c2_204eab9e-1b40-45f5-be0d-1fd142340ac9/konnectivity-agent/0.log"
Jul 16 14:22:02.693054 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:02.692958    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-62.ec2.internal_06ac39ebd4fa4a02fa3ca1bc0e53b517/haproxy/0.log"
Jul 16 14:22:08.255974 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:08.255888    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-b8j8h_d5d0a908-b706-4ec7-9793-a02aba39dad2/manager/0.log"
Jul 16 14:22:10.557647 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.557617    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8j9f_1d1a6db7-1749-4d69-8e4e-e8fde254e528/node-exporter/0.log"
Jul 16 14:22:10.581940 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.581913    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8j9f_1d1a6db7-1749-4d69-8e4e-e8fde254e528/kube-rbac-proxy/0.log"
Jul 16 14:22:10.613230 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.613202    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8j9f_1d1a6db7-1749-4d69-8e4e-e8fde254e528/init-textfile/0.log"
Jul 16 14:22:10.781590 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.781560    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/prometheus/0.log"
Jul 16 14:22:10.813414 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.813331    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/config-reloader/0.log"
Jul 16 14:22:10.844672 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.844648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/thanos-sidecar/0.log"
Jul 16 14:22:10.873240 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.873218    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/kube-rbac-proxy-web/0.log"
Jul 16 14:22:10.912748 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.912728    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/kube-rbac-proxy/0.log"
Jul 16 14:22:10.948369 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.948346    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/kube-rbac-proxy-thanos/0.log"
Jul 16 14:22:10.972953 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:10.972932    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_618858fe-ec8a-439b-a23d-079db87a4d1a/init-config-reloader/0.log"
Jul 16 14:22:11.101769 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:11.101694    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cf7fb8896-6q5vk_b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f/telemeter-client/0.log"
Jul 16 14:22:11.126847 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:11.126823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cf7fb8896-6q5vk_b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f/reload/0.log"
Jul 16 14:22:11.157696 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:11.157664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cf7fb8896-6q5vk_b57f818c-9a9e-4bc9-bdf6-2bd3bf236c4f/kube-rbac-proxy/0.log"
Jul 16 14:22:12.548114 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:12.548084    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wt2fl_32adff5f-4d40-4015-95bd-403c254c7b12/networking-console-plugin/0.log"
Jul 16 14:22:13.138787 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.138761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/1.log"
Jul 16 14:22:13.143421 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.143401    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-s7kst_7f6128d3-c018-4e00-b2d9-f7b61acfede3/console-operator/2.log"
Jul 16 14:22:13.945370 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945337    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"]
Jul 16 14:22:13.945957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945867    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.945957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945883    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.945957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945894    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.945957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945899    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.945957 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945954    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.946202 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.945964    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f1ea4be-770a-4be6-8b9a-e350a19a7eb1" containerName="istio-proxy"
Jul 16 14:22:13.949011 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.948992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:13.951780 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.951761    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhhqm\"/\"openshift-service-ca.crt\""
Jul 16 14:22:13.952952 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.952932    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mhhqm\"/\"default-dockercfg-6lmwq\""
Jul 16 14:22:13.953073 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.952956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mhhqm\"/\"kube-root-ca.crt\""
Jul 16 14:22:13.958896 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:13.958864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"]
Jul 16 14:22:14.141219 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.141178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwwn\" (UniqueName: \"kubernetes.io/projected/3c8cf6f1-aa39-4422-8482-501586e3fa7c-kube-api-access-wlwwn\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.141405 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.141239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-podres\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.141405 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.141266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-sys\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.141405 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.141298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-proc\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.141405 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.141316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-lib-modules\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.241933 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.241836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwwn\" (UniqueName: \"kubernetes.io/projected/3c8cf6f1-aa39-4422-8482-501586e3fa7c-kube-api-access-wlwwn\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.241933 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.241892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-podres\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.241933 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.241921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-sys\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.241951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-proc\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.241969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-lib-modules\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.242033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-podres\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.242033    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-sys\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.242076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-proc\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.242162 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.242155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8cf6f1-aa39-4422-8482-501586e3fa7c-lib-modules\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.252240 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.252203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwwn\" (UniqueName: \"kubernetes.io/projected/3c8cf6f1-aa39-4422-8482-501586e3fa7c-kube-api-access-wlwwn\") pod \"perf-node-gather-daemonset-7r5dc\" (UID: \"3c8cf6f1-aa39-4422-8482-501586e3fa7c\") " pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.259198 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.259175    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.396986 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.396963    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"]
Jul 16 14:22:14.399031 ip-10-0-137-62 kubenswrapper[2558]: W0716 14:22:14.399000    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c8cf6f1_aa39_4422_8482_501586e3fa7c.slice/crio-54c30e863e9345e446c5ba5d7da21a0270bc62ee8d93763dfda84288e95912e8 WatchSource:0}: Error finding container 54c30e863e9345e446c5ba5d7da21a0270bc62ee8d93763dfda84288e95912e8: Status 404 returned error can't find the container with id 54c30e863e9345e446c5ba5d7da21a0270bc62ee8d93763dfda84288e95912e8
Jul 16 14:22:14.775770 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.775729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc" event={"ID":"3c8cf6f1-aa39-4422-8482-501586e3fa7c","Type":"ContainerStarted","Data":"7251535c7496eb5942f1097b5f8a3fb312f9eba3107b7acca41b4b5e3e4c9527"}
Jul 16 14:22:14.775977 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.775797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc" event={"ID":"3c8cf6f1-aa39-4422-8482-501586e3fa7c","Type":"ContainerStarted","Data":"54c30e863e9345e446c5ba5d7da21a0270bc62ee8d93763dfda84288e95912e8"}
Jul 16 14:22:14.775977 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.775839    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:14.793962 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:14.793908    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc" podStartSLOduration=1.793890389 podStartE2EDuration="1.793890389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 14:22:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 14:22:14.792878563 +0000 UTC m=+2498.791910441" watchObservedRunningTime="2026-07-16 14:22:14.793890389 +0000 UTC m=+2498.792922266"
Jul 16 14:22:15.545815 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:15.545780    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xr8t4_4c05b0c3-48f6-4e83-9075-91b624b6b6bb/dns/0.log"
Jul 16 14:22:15.571323 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:15.571298    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xr8t4_4c05b0c3-48f6-4e83-9075-91b624b6b6bb/kube-rbac-proxy/0.log"
Jul 16 14:22:15.626290 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:15.626264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kmf9r_9bd44e71-7096-4513-9215-4432fb3bb979/dns-node-resolver/0.log"
Jul 16 14:22:16.250479 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:16.250448    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8m4ms_8d66373d-40f1-4521-aa76-1c34b8406d1c/node-ca/0.log"
Jul 16 14:22:17.264990 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:17.264956    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lnt87_d8d7fda0-3f20-4426-8026-1e4ed49c0e9d/istio-proxy/0.log"
Jul 16 14:22:17.569775 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:17.569732    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bwscm_79fd2a3f-5686-4159-90dc-ddfdffc093dd/payload-pre-processing/0.log"
Jul 16 14:22:18.411367 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:18.411337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkrf5_a799d138-cd10-44b0-bdc7-94d8be95575c/serve-healthcheck-canary/0.log"
Jul 16 14:22:18.955535 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:18.955505    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-q9prr_8fe5b7bc-0a11-4a86-b7eb-c71e746a9575/insights-operator/0.log"
Jul 16 14:22:18.955728 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:18.955715    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-q9prr_8fe5b7bc-0a11-4a86-b7eb-c71e746a9575/insights-operator/1.log"
Jul 16 14:22:18.981219 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:18.981193    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hbbb_fe90d63f-2ac3-4bb9-9595-a2eaefe60b99/kube-rbac-proxy/0.log"
Jul 16 14:22:19.007259 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:19.007231    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hbbb_fe90d63f-2ac3-4bb9-9595-a2eaefe60b99/exporter/0.log"
Jul 16 14:22:19.041997 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:19.041977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7hbbb_fe90d63f-2ac3-4bb9-9595-a2eaefe60b99/extractor/0.log"
Jul 16 14:22:20.790788 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:20.790758    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mhhqm/perf-node-gather-daemonset-7r5dc"
Jul 16 14:22:21.455728 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:21.455699    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-z8qc2_edc0b624-bd3f-4826-b561-73c50db4e0a7/manager/0.log"
Jul 16 14:22:21.590556 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:21.590525    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hslsf_e7b6ef65-1204-4be7-b4c7-8ae098a17b53/manager/0.log"
Jul 16 14:22:21.679929 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:21.679899    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-97689c86b-z6v46_18671c3c-e20f-486c-9bfa-656d52378fb8/manager/0.log"
Jul 16 14:22:21.994155 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:21.994127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558d6dc665-dlxps_be46a2eb-a276-4997-b90f-25b83426ce46/manager/0.log"
Jul 16 14:22:22.013211 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:22.013185    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558d6dc665-dlxps_be46a2eb-a276-4997-b90f-25b83426ce46/copy-manifests/0.log"
Jul 16 14:22:23.411777 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:23.411750    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6769696c89-j8tt5_9a6258e6-3bfc-47ca-8df2-10f20daea3d8/manager/0.log"
Jul 16 14:22:23.541107 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:23.541085    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lnt87_d8d7fda0-3f20-4426-8026-1e4ed49c0e9d/istio-proxy/0.log"
Jul 16 14:22:23.794746 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:23.794656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bwscm_79fd2a3f-5686-4159-90dc-ddfdffc093dd/payload-pre-processing/0.log"
Jul 16 14:22:25.021309 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:25.021279    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lnt87_d8d7fda0-3f20-4426-8026-1e4ed49c0e9d/istio-proxy/0.log"
Jul 16 14:22:25.281389 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:25.281362    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-bwscm_79fd2a3f-5686-4159-90dc-ddfdffc093dd/payload-pre-processing/0.log"
Jul 16 14:22:30.458161 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.458129    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/kube-multus-additional-cni-plugins/0.log"
Jul 16 14:22:30.490781 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.490758    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/egress-router-binary-copy/0.log"
Jul 16 14:22:30.527058 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.527035    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/cni-plugins/0.log"
Jul 16 14:22:30.551104 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.551081    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/bond-cni-plugin/0.log"
Jul 16 14:22:30.573809 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.573791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/routeoverride-cni/0.log"
Jul 16 14:22:30.600741 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.600721    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/whereabouts-cni-bincopy/0.log"
Jul 16 14:22:30.623105 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.623087    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv2x5_f9f1bf03-b72f-4618-8beb-0ead64957375/whereabouts-cni/0.log"
Jul 16 14:22:30.865819 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.865789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sprk4_e53e301e-013f-4314-809e-4cad5c5d64c0/kube-multus/0.log"
Jul 16 14:22:30.895640 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.895604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-726ml_47dc235e-43e7-48c9-8d3d-473816e01efc/network-metrics-daemon/0.log"
Jul 16 14:22:30.922060 ip-10-0-137-62 kubenswrapper[2558]: I0716 14:22:30.922030    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-726ml_47dc235e-43e7-48c9-8d3d-473816e01efc/kube-rbac-proxy/0.log"